-- Logs begin at Fri 2022-09-16 18:43:33 UTC, end at Fri 2022-09-16 19:52:41 UTC. -- Sep 16 19:12:04.762574 dv-cinder-850320-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 16 19:12:04.773050 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 16 19:12:04.775586 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 19:12:04 2022] *** Sep 16 19:12:04.775586 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 19:12:04.775586 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 19:12:04.775586 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: nodename: dv-cinder-850320-7-iscsi Sep 16 19:12:04.775586 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: machine: x86_64 Sep 16 19:12:04.775586 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: clock source: unix Sep 16 19:12:04.775586 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: pcre jit disabled Sep 16 19:12:04.775586 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: detected number of CPU cores: 4 Sep 16 19:12:04.775586 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: current working directory: / Sep 16 19:12:04.775586 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: detected binary path: /usr/bin/uwsgi-core Sep 16 19:12:04.776120 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: your processes number limit is 47680 Sep 16 19:12:04.776120 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: your memory page size is 4096 bytes Sep 16 19:12:04.776120 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: detected max file descriptor number: 2048 Sep 16 19:12:04.776120 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: lock engine: pthread robust mutexes Sep 16 19:12:04.776120 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: thunder lock: enabled Sep 16 19:12:04.776120 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 16 19:12:04.776120 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 19:12:04.814273 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: Python main interpreter initialized at 0x5608df5409c0 Sep 16 19:12:04.814273 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: python threads support enabled Sep 16 19:12:04.814273 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: your server socket listen backlog is limited to 100 connections Sep 16 19:12:04.814273 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: your mercy for graceful operations on workers is 90 seconds Sep 16 19:12:04.814590 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 19:12:04.814693 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: *** Operational MODE: preforking *** Sep 16 19:12:04.814964 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: *** uWSGI is running in multiple interpreter mode *** Sep 16 19:12:04.814964 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: spawned uWSGI master process (pid: 81428) Sep 16 19:12:04.815157 dv-cinder-850320-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 16 19:12:04.820321 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: spawned uWSGI worker 1 (pid: 81441, cores: 1) Sep 16 19:12:04.820321 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: spawned uWSGI worker 2 (pid: 81442, cores: 1) Sep 16 19:12:04.820321 dv-cinder-850320-7-iscsi devstack@keystone.service[81428]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 19:12:09.058668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 19:12:09.058668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: from cryptography.utils import int_from_bytes Sep 16 19:12:09.059474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 19:12:09.059474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: from cryptography.utils import int_from_bytes Sep 16 19:12:09.059924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 19:12:09.059924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: from cryptography.utils import int_from_bytes Sep 16 19:12:09.060046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 19:12:09.060046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: from cryptography.utils import int_from_bytes Sep 16 19:12:09.108564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 19:12:09.108765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 19:12:09.108765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 19:12:09.108914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 19:12:09.108982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] command line args: [] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 19:12:09.109048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] command line args: [] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 19:12:09.109197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 19:12:09.109328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 19:12:09.109328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ================================================================================ {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 19:12:09.109467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ================================================================================ {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 19:12:09.109586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] admin_token = **** {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.109676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] admin_token = **** {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.109799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] config_dir = [] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.109883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] config_dir = [] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.109993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.110069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.110182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] config_source = [] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.110270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] config_source = [] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.110338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] debug = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.110397 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] debug = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.110532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.110784 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.110871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.110937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.111056 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.111129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.111303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.111429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.111504 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.111565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.111811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] list_limit = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.111930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] list_limit = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] log_config_append = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] log_config_append = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112260 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] log_dir = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] log_dir = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] log_file = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] log_file = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.112951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.113133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.113268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.113346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.113418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.113546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.113627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.113696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.113764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.113893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.113976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.114170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.114361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.114451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.114522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.114588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.114648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.114788 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.114910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.114998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.115070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.115267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.115399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.115479 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.115550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.115764 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.115897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.116248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.116409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.116409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] publish_errors = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.116572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] publish_errors = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.116642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.116716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.116887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.117065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.117065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.117295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.117295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.117516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.117677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.117805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.117918 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] standard_threads = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.118034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] standard_threads = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.118034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.118271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.118402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.118402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.118668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.118780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] use_journal = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.118948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.119062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] use_json = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.119181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] use_journal = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.119292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] use_stderr = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.119410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] use_json = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.119522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] use_syslog = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.119644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] use_stderr = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.119755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.119865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] use_syslog = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.119975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.120085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:12:09.120200 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.120319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.120460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.120575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.120686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.120795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.120906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.121118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.121235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.121344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.121454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.121565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.121675 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.121793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.121904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.122013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.122123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.122239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.122356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.122475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.122588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.122704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.122820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.122931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.123048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.123170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.123279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.123394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.123394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.123610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.123729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.123852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.123974 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.124085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.124201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.124318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.124531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.124653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.124766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.124876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.124986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.125095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.125219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.125331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.125442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.125557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.125694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.125808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.125926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.126044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.126155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.126264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.126373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.126491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.126609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.126731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.126852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.126969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.127079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.127189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.127306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.127418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.127527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.127636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.127746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.127856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.127973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.128084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.128199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.128310 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.128445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.128557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.128681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.128793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.128909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.129020 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.129129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.129238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.129355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.129472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.129583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.129693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.129802 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.129912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.130098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.130211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.130321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.130432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.130542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.130651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.130770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.130888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.131000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.131116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.131235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.131348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.131469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.131586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.131697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.131812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.131923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.132039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.132158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.132253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.132352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.132480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.132576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.132677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.132771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.132865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.132958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.133093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.133199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.133353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.133575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.133695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.133797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.133907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.134018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.134139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.134251 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.134369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.134480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.134590 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.134710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.134830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.134830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.135079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.135198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.135317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.135419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.135527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.135638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.135756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.135868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.135986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.136098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.136210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.136320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.136469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.136590 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.136702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.136814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.136929 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.137039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.137158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.137272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.137383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.137383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.137604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.137715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.137834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.137946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.138057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.138173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.138291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.138404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.138523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.138636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.138753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.138865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.138976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.139093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.139214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.139333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.139447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.139557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.139668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.139779 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.139900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.140013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.140124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.140235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.140346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.140469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.140592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.140705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.140816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.140926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.141036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.141146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.141339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.141454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.141571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.141682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.141793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.141912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.142036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.142156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.142268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.142380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.142492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.142603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.142721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.142841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.142953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.143064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.143175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.143285 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.143399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.143517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.143631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.143754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.143867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.143977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.144088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.144206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.144318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.144487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.144617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.144731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.144848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.144989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.145114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] auth.external = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.145235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] auth.external = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.145350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.145462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.145573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.145686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.145799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.145917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.146030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] auth.password = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.146141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] auth.password = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.146253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] auth.token = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.146364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] auth.token = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.146475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.146594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.146708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.146822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.146940 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.147053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.147164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.147283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.147403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.147516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.147631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.147743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.147854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.147973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.148086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] credential.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.148197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] credential.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.148308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.148434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.148548 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.148672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.148786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.149060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.149187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.149301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.149414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.149536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.149656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.149775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.149775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.149996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.149996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.150215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.150328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.150441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.150553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.150664 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.150776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.150897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.151011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.151122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.151236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.151348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.151460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.151580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.151693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.151805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.151918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] federation.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.152030 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] federation.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.152151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.152266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.152420 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.152537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.152650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.152761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.152886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.153001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.153113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.153225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.153336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.153495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.153617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.153731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.153843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.153955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.154067 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.154210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.154332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.154451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.154564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.154676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.154798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.154910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.155098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.155327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.155446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.155559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.155671 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.155791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.155903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.156015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.156133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.156245 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.156356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.156493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.156608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.156719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.156831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.156946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.157058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.157058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.157277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.157388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.157500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.157611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.157723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.157842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.157955 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.158070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.158181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.158293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.158405 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.158524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.158637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.158748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.158860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.158971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.159082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.159201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.159315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.159427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.159558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.159670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.159781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.159901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.160014 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.160125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.160236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.160349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.160561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.160693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.160807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.160919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.161032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.161143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.161262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.161377 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.161489 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.161600 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.161711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.161822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.161941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.162054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.162165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.162276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.162387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.162499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.162619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.162732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.162843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.162954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.163065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.163176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.163297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.163410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.163522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.163632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.163743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.163853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.163972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.164084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.164196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.164306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.164434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.164607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.164736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.164851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.164962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.165074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.165186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.165297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.165416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.165529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.165642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.165753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.165865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.165976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.166096 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.166214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.166327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.166438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.166549 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.166661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.166780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.166893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.167009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.167121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.167233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.167345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.167464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.167580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.167693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.167805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.167916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.168027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.168146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.168259 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.168370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.168531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.168644 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.168756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.168880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.168995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.169106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.169216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.169328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.169439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.169560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.169673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.169785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.169896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.170008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.170118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.170243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.170356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.170468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.170579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.170690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.170802 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.170922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.171035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.171152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.171266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.171378 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.171489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.171608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.171722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.171833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.171947 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.172059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.172170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.172291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.172421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.172535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.172646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.172758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.172869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.172993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.173107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.173219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.173336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.173441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.173551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.173671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.173784 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.173895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.174008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.174126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.174239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.174359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.174472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.174583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.174694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.174805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.174915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.175036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.175149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] resource.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.175260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] resource.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.175372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.175484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.175602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.175602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.175813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.175813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.176021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.176021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.176238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.176351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.176516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.176628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.176742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.176857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.177049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.177166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.177278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.177389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] role.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.177501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.177612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] role.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.177732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] role.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.177845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.177956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] role.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.178068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.178180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.178291 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.178412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.178525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.178636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.178748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.178860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.178971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.179091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.179206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.179317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.179428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.179540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.179651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.179770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.179995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.180107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.180580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.180696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.180824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.180939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.181051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.181164 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.181276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.181276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.181495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.181495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.181706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.181818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.181930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.182042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.182162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.182276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.182389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.182501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.182615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.182735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.182848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.182959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.183071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.183182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.183294 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.183415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.183521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.183632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.183744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.183856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.183968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.184087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.184200 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.184311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.184436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.184549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.184661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.184785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.184898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.185009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.185121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.185232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.185343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.185462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.185575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.185687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] token.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.185798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.185908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.186019 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] token.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.186138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.186251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.186369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.186481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.186593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.186705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.186823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.186936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.187047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.187161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.187273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.187384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.187504 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.187617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.187730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.187840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.187951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.188062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.188183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.188295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.188420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.188420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.188631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.188631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.188851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.188965 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.189076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.189076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.189302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.189415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.189526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.189526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.189757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.connection = **** {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.189757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.189978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.190090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.190201 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.connection = **** {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.190312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.190423 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.190542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.190655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.190767 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.190878 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.190995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.191107 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.191226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.191339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.191450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.191561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.191672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.191785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.191905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.192018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.192129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.192240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.192352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.192500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.192625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.192738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.192851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.192962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.193074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.193185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.193304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.193417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.193529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.193640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.193751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.193863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.193988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 19:12:09.194103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.194103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:12:09.194103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 19:12:09.221674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.221904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.221988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.222129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.222212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.222393 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.230586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.230925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.258258 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.258549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.259156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.259407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.310706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.311474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.358743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.358968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.359273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.359505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.516838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.517045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.517167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.517294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.517402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.517480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.517588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.517678 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.517827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.517966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.518104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.518219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.540967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.541173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.541267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.541425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.541508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.541580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.541655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.541775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.541899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.541982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.542099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.542177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.542291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.542473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.553213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.553744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.565914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.566045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.566268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.566405 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.566493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.566569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.566718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.566842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.566990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.567075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.567138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.567211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.567328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.567562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:12:09.583988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.584195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 19:12:09.584558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.584680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.584816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 19:12:09.584917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 19:12:09.585042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.585120 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.585268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.585392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 19:12:09.585522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.585607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.585718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.585798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.586060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.586323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.595371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.595650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.595916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.596038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.596167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.596342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.596641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.596930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.603151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.604008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.606051 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.606331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.606614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.606905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.607027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.607166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.607265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.607390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.607469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.607684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.607809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.607957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.608040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.608203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.608327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.608499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.608642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.608726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.608796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.609087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.609360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.609630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.631144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.632475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.632601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.632877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.633980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.634269 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.637517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.637804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.638080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.638944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.639234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.639517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.644331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.644643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.645863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.646153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.650256 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.650552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.650836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.651123 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.651398 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.651674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.651876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.651977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.652157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.652282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.652467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.652737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.653022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.653300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.653558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.653829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.667488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.667765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.669490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.669783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.671588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.673629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.674800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.675097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.676890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.677189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.679353 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.681454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.682711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.684597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.685935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.686233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.686516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.686800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.687071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.687350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.687794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.688101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.688405 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.688700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.688996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.689272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.703700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.703990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.704256 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.704544 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.705732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.705878 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.706123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.706389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.711305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.713053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.713470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.714565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.714840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.715003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.716583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.716862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.717508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.717828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.718113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.718382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.718771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.719498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.719785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.720080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.720362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.720774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.729924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.730215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.730495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.730778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.731155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.731440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.731723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.731928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.732216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.732531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.732818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.733204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.733497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.733790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.747070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.749330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.749966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.752253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.752833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.754325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.755174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.756114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.756412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.756823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.756987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.758631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.758967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.759300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.763309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.764780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.765574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.767041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.767625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.768020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.768306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.768607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.769969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.770371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.770665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.770947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.776854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.777141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.777417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.778865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.779156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.779443 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.784219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.784527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.784805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.785075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.785350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.785628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.785903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.786171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.786324 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:12:09.786423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.786595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.786717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.786884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.787013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.787167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.787287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.787448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.787567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.787715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.787880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.788001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.788261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.788563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.788836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.789126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.789468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.789833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.790267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:12:09.821827 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5608df5409c0 pid: 81441 (default app) Sep 16 19:12:09.824791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5608df5409c0 pid: 81442 (default app) Sep 16 19:12:09.825451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f19868-636d-4b17-8690-5c50bfb748b6 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:09.825734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f19868-636d-4b17-8690-5c50bfb748b6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:09.826005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f19868-636d-4b17-8690-5c50bfb748b6 None None] PATH_INFO: `/v3` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:09.830195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Fri Sep 16 19:12:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:16.714918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449ada5-5a81-42ba-b0ec-0db340e190eb None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:16.715920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449ada5-5a81-42ba-b0ec-0db340e190eb None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:16.715920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449ada5-5a81-42ba-b0ec-0db340e190eb None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:16.723031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:16 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:16.730183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:16.730722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:16.730722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:16.801321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: INFO dbcounter [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] Registered counter for database keystone Sep 16 19:12:16.820924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG oslo_db.sqlalchemy.engines [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 19:12:16.832963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writer thread running {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 19:12:17.023159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG passlib.handlers.bcrypt [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81441) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 19:12:17.023549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG passlib.handlers.bcrypt [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81441) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 19:12:17.082349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:17.083946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:17.222434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 16 19:12:17.709220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449ada5-5a81-42ba-b0ec-0db340e190eb None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:17.781804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: INFO dbcounter [None req-6449ada5-5a81-42ba-b0ec-0db340e190eb None None] Registered counter for database keystone Sep 16 19:12:17.806730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG oslo_db.sqlalchemy.engines [None req-6449ada5-5a81-42ba-b0ec-0db340e190eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 19:12:17.817263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writer thread running {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 19:12:17.945283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449ada5-5a81-42ba-b0ec-0db340e190eb None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:17.952538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0f1d1-0bca-42ef-b52b-9dd6690b91bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:17.953569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0f1d1-0bca-42ef-b52b-9dd6690b91bc admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:17.954044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0f1d1-0bca-42ef-b52b-9dd6690b91bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:17.954498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0f1d1-0bca-42ef-b52b-9dd6690b91bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:17.966274 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0f1d1-0bca-42ef-b52b-9dd6690b91bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:18.017217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: WARNING keystone.common.rbac_enforcer.enforcer [None req-21d0f1d1-0bca-42ef-b52b-9dd6690b91bc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 19:12:18.017535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0f1d1-0bca-42ef-b52b-9dd6690b91bc admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:18.028059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Fri Sep 16 19:12:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:12:18.035200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:18.056314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba560d-f7ea-4512-8909-4393000aa741 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:18.062848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f9135-30af-4898-aa29-697363bd9808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:18.063989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f9135-30af-4898-aa29-697363bd9808 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:18.064275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f9135-30af-4898-aa29-697363bd9808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:18.064572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f9135-30af-4898-aa29-697363bd9808 admin admin] PATH_INFO: `/v3/projects/e5d7d65acd0047cb8a5a68c90b00c1bb` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:18.066388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f9135-30af-4898-aa29-697363bd9808 admin admin] RBAC: Authorizing `identity:get_project(project_id=e5d7d65acd0047cb8a5a68c90b00c1bb)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:18.119173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5a6f9135-30af-4898-aa29-697363bd9808 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 19:12:18.119520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f9135-30af-4898-aa29-697363bd9808 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:18.124051 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Fri Sep 16 19:12:18 2022] GET /identity/v3/projects/e5d7d65acd0047cb8a5a68c90b00c1bb => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:20.317366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086808-3e20-4f44-9eb4-f532203d4186 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:20.318236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086808-3e20-4f44-9eb4-f532203d4186 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:20.318236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086808-3e20-4f44-9eb4-f532203d4186 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:20.323767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:20.330658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2ee68-e739-4022-9d34-f784c3855d1f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:20.331079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2ee68-e739-4022-9d34-f784c3855d1f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:20.331224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2ee68-e739-4022-9d34-f784c3855d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:20.359644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-29f2ee68-e739-4022-9d34-f784c3855d1f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:20.361200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-29f2ee68-e739-4022-9d34-f784c3855d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:20.370941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 16 19:12:20.635589 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2086808-3e20-4f44-9eb4-f532203d4186 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:20.655568 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2086808-3e20-4f44-9eb4-f532203d4186 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:20.661128 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6e3f-c211-4cc2-b1c3-ebac198bab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:20.661722 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6e3f-c211-4cc2-b1c3-ebac198bab71 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:20.662003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6e3f-c211-4cc2-b1c3-ebac198bab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:20.662278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6e3f-c211-4cc2-b1c3-ebac198bab71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:20.670728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db6e3f-c211-4cc2-b1c3-ebac198bab71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:20.672548 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db6e3f-c211-4cc2-b1c3-ebac198bab71 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:20.681506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Fri Sep 16 19:12:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:12:20.687128 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2ee68-e739-4022-9d34-f784c3855d1f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:20.697566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2ee68-e739-4022-9d34-f784c3855d1f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:20.703572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccf0b6-7cbd-460c-9d62-fb9e9649b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:20.704240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf0b6-7cbd-460c-9d62-fb9e9649b47f admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:20.704549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf0b6-7cbd-460c-9d62-fb9e9649b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:20.704822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf0b6-7cbd-460c-9d62-fb9e9649b47f admin admin] PATH_INFO: `/v3/users/0f9ac1f3ebbc4a86af050232d3157e46` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:20.706298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf0b6-7cbd-460c-9d62-fb9e9649b47f admin admin] RBAC: Authorizing `identity:get_user(user_id=0f9ac1f3ebbc4a86af050232d3157e46)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:20.708164 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf0b6-7cbd-460c-9d62-fb9e9649b47f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:20.709732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Fri Sep 16 19:12:20 2022] GET /identity/v3/users/0f9ac1f3ebbc4a86af050232d3157e46 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:22.929900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f74f5-c110-48f7-864d-721b6759bd34 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:22.930533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f74f5-c110-48f7-864d-721b6759bd34 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:22.930533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f74f5-c110-48f7-864d-721b6759bd34 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:22.931898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:22.937252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2e12e-47e6-4ab8-8c34-11023825d11b None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:22.937829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2e12e-47e6-4ab8-8c34-11023825d11b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:22.938107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2e12e-47e6-4ab8-8c34-11023825d11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:22.958093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-92e2e12e-47e6-4ab8-8c34-11023825d11b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:22.959538 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-92e2e12e-47e6-4ab8-8c34-11023825d11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:22.960791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be5a58-4cbc-425b-b4dc-3b395167ccd2 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:22.961666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be5a58-4cbc-425b-b4dc-3b395167ccd2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:22.961833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be5a58-4cbc-425b-b4dc-3b395167ccd2 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:22.963094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:12:22.968051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa6fb-79b3-4a19-a961-26d3f7a9786e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:22.968329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa6fb-79b3-4a19-a961-26d3f7a9786e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:22.968634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa6fb-79b3-4a19-a961-26d3f7a9786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:23.010972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG passlib.handlers.bcrypt [None req-d1eaa6fb-79b3-4a19-a961-26d3f7a9786e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81442) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 19:12:23.011350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG passlib.handlers.bcrypt [None req-d1eaa6fb-79b3-4a19-a961-26d3f7a9786e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81442) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 19:12:23.046457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:23.059762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-d1eaa6fb-79b3-4a19-a961-26d3f7a9786e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:23.061383 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d1eaa6fb-79b3-4a19-a961-26d3f7a9786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:23.163555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:12:23.311880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2e12e-47e6-4ab8-8c34-11023825d11b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:23.338310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:23.418866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2e12e-47e6-4ab8-8c34-11023825d11b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:23.422894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaa6fb-79b3-4a19-a961-26d3f7a9786e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:23.454404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f2762-1f6e-420e-976d-b9aaed58da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:23.455047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f2762-1f6e-420e-976d-b9aaed58da97 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:23.455323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f2762-1f6e-420e-976d-b9aaed58da97 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:23.455597 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f2762-1f6e-420e-976d-b9aaed58da97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:23.466848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f2762-1f6e-420e-976d-b9aaed58da97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-859f2762-1f6e-420e-976d-b9aaed58da97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:23.475639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:23.477472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:23.478670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:23.482860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f2762-1f6e-420e-976d-b9aaed58da97 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:23.526064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaa6fb-79b3-4a19-a961-26d3f7a9786e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:23.528467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:23.563968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:23.565813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6ba26-b9ff-47e3-9c9d-828289a75e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:23.566723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6ba26-b9ff-47e3-9c9d-828289a75e9a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:23.567008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6ba26-b9ff-47e3-9c9d-828289a75e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:23.567284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6ba26-b9ff-47e3-9c9d-828289a75e9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:23.583931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f2762-1f6e-420e-976d-b9aaed58da97 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:23.617521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e56ca7-ae97-4388-a53a-7b946dece514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:23.618116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56ca7-ae97-4388-a53a-7b946dece514 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:23.618395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56ca7-ae97-4388-a53a-7b946dece514 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:23.618663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56ca7-ae97-4388-a53a-7b946dece514 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:23.619338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56ca7-ae97-4388-a53a-7b946dece514 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:23.619639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56ca7-ae97-4388-a53a-7b946dece514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:23.621078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56ca7-ae97-4388-a53a-7b946dece514 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:23.632886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:23.638577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6ba26-b9ff-47e3-9c9d-828289a75e9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:23.638803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e56ca7-ae97-4388-a53a-7b946dece514 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:23.640145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6ba26-b9ff-47e3-9c9d-828289a75e9a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:23.740411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e56ca7-ae97-4388-a53a-7b946dece514 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:23.741312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:12:23.747065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6ba26-b9ff-47e3-9c9d-828289a75e9a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:23.749919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:23.776088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616c469-9573-4255-bcdf-1f6f64225851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:23.776772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616c469-9573-4255-bcdf-1f6f64225851 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:23.777049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616c469-9573-4255-bcdf-1f6f64225851 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:23.777319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616c469-9573-4255-bcdf-1f6f64225851 None admin] PATH_INFO: `/v3/users/0f9ac1f3ebbc4a86af050232d3157e46` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:23.778471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616c469-9573-4255-bcdf-1f6f64225851 None admin] RBAC: Authorizing `identity:get_user(user_id=0f9ac1f3ebbc4a86af050232d3157e46)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:23.779948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616c469-9573-4255-bcdf-1f6f64225851 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:23.781556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:23 2022] GET /identity/v3/users/0f9ac1f3ebbc4a86af050232d3157e46 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:23.786899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616c469-9573-4255-bcdf-1f6f64225851 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:23.803181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:23.849532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6ba26-b9ff-47e3-9c9d-828289a75e9a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:23.883833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902605d1-bdf0-4c48-be9c-5c1d93e03c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:23.884730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902605d1-bdf0-4c48-be9c-5c1d93e03c72 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:23.885006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902605d1-bdf0-4c48-be9c-5c1d93e03c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:23.885275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902605d1-bdf0-4c48-be9c-5c1d93e03c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:23.889889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616c469-9573-4255-bcdf-1f6f64225851 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:23.904099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902605d1-bdf0-4c48-be9c-5c1d93e03c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:23.905725 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902605d1-bdf0-4c48-be9c-5c1d93e03c72 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:23.923244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0245e6b-d4d9-449f-b6d3-dd0ebf8c7649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:23.923880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0245e6b-d4d9-449f-b6d3-dd0ebf8c7649 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:23.924156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0245e6b-d4d9-449f-b6d3-dd0ebf8c7649 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:23.924454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0245e6b-d4d9-449f-b6d3-dd0ebf8c7649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-902605d1-bdf0-4c48-be9c-5c1d93e03c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:12:23.925151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:23.925963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:12:23.927032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:12:23.927032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:12:23.927032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:23.927196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0245e6b-d4d9-449f-b6d3-dd0ebf8c7649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:23.927271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 9/18] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:23.927336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0245e6b-d4d9-449f-b6d3-dd0ebf8c7649 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:23.928693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 10/19] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:23.932326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902605d1-bdf0-4c48-be9c-5c1d93e03c72 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:23.934941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0245e6b-d4d9-449f-b6d3-dd0ebf8c7649 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:23.996537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:24.023874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:24.043871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902605d1-bdf0-4c48-be9c-5c1d93e03c72 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:24.044407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0245e6b-d4d9-449f-b6d3-dd0ebf8c7649 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:24.077224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f6905-d1a9-4949-af6d-c9b8d1145cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:24.077474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e8d65-3642-4081-8d73-e305074bd321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:24.077841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6905-d1a9-4949-af6d-c9b8d1145cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:24.078079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8d65-3642-4081-8d73-e305074bd321 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:24.078165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6905-d1a9-4949-af6d-c9b8d1145cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:24.078355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8d65-3642-4081-8d73-e305074bd321 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:24.078441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6905-d1a9-4949-af6d-c9b8d1145cf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:24.078628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8d65-3642-4081-8d73-e305074bd321 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:24.079105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6905-d1a9-4949-af6d-c9b8d1145cf6 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.domain.id=default, user.id=0f9ac1f3ebbc4a86af050232d3157e46) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:24.079260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e8d65-3642-4081-8d73-e305074bd321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:24.079421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6905-d1a9-4949-af6d-c9b8d1145cf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:24.079560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e8d65-3642-4081-8d73-e305074bd321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:24.080939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6905-d1a9-4949-af6d-c9b8d1145cf6 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:24.081028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e8d65-3642-4081-8d73-e305074bd321 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:24.087648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Fri Sep 16 19:12:23 2022] GET /identity/v3/role_assignments?user.id=0f9ac1f3ebbc4a86af050232d3157e46&scope.domain.id=default&role.id=71bed99a52684ba990097719b40ef99d => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:24.099077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:26.553306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1d61-4dd0-4880-abb4-624142028599 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:26.553841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1d61-4dd0-4880-abb4-624142028599 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:26.553841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1d61-4dd0-4880-abb4-624142028599 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:26.555857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:26.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d9b64-b30d-4a4d-aac6-7c411a0dc74e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:26.562754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d9b64-b30d-4a4d-aac6-7c411a0dc74e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:26.562754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d9b64-b30d-4a4d-aac6-7c411a0dc74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:26.588768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-c72d9b64-b30d-4a4d-aac6-7c411a0dc74e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:26.590002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c72d9b64-b30d-4a4d-aac6-7c411a0dc74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:26.693941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:12:26.995890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcb392-2551-4e38-9c51-e92dda3d2ee1 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:26.996075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcb392-2551-4e38-9c51-e92dda3d2ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:26.996333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcb392-2551-4e38-9c51-e92dda3d2ee1 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:26.998000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:27.004074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90529a-69ca-43f4-82dd-7e17b6e66e26 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:27.004717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90529a-69ca-43f4-82dd-7e17b6e66e26 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:27.005179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90529a-69ca-43f4-82dd-7e17b6e66e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:27.033704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-df90529a-69ca-43f4-82dd-7e17b6e66e26 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:27.035285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-df90529a-69ca-43f4-82dd-7e17b6e66e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:27.080216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:27.106739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 12/25] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:27.155019 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d8af-88af-4f79-a514-fd0a3b92fe04 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:27.155650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d8af-88af-4f79-a514-fd0a3b92fe04 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:27.156112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d8af-88af-4f79-a514-fd0a3b92fe04 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:27.157763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 14/26] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:27.163509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320615fa-cd86-4689-9df7-958986872649 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:27.163863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320615fa-cd86-4689-9df7-958986872649 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:27.164151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320615fa-cd86-4689-9df7-958986872649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:27.188764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-320615fa-cd86-4689-9df7-958986872649 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:27.189943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-320615fa-cd86-4689-9df7-958986872649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:27.219886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d8af-88af-4f79-a514-fd0a3b92fe04 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:27.292662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 13/27] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:27.293984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447c39f-d2c3-4926-b2ad-cf1bf445cf66 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:27.294266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447c39f-d2c3-4926-b2ad-cf1bf445cf66 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:27.294540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447c39f-d2c3-4926-b2ad-cf1bf445cf66 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:27.304753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 14/28] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:27.306026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40af78-7a12-4a14-83a1-0b38cfc40776 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:27.306304 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40af78-7a12-4a14-83a1-0b38cfc40776 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:27.306577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40af78-7a12-4a14-83a1-0b38cfc40776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:27.340084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-1f40af78-7a12-4a14-83a1-0b38cfc40776 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:27.341313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-1f40af78-7a12-4a14-83a1-0b38cfc40776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:27.424527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d8af-88af-4f79-a514-fd0a3b92fe04 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:27.467230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 15/29] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:27.481545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40af78-7a12-4a14-83a1-0b38cfc40776 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:27.501641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776c651-5ec2-4f9f-8abf-81d56dafb57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:27.502300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776c651-5ec2-4f9f-8abf-81d56dafb57f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:27.502578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776c651-5ec2-4f9f-8abf-81d56dafb57f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:27.502848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776c651-5ec2-4f9f-8abf-81d56dafb57f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:27.526331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776c651-5ec2-4f9f-8abf-81d56dafb57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:27.527831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776c651-5ec2-4f9f-8abf-81d56dafb57f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:27.537803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-0776c651-5ec2-4f9f-8abf-81d56dafb57f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:12:27.568486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:27.569785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:12:27.570673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:12:27.570673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:12:27.570673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:27.570825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:27.571155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 15/30] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:12:27.572133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776c651-5ec2-4f9f-8abf-81d56dafb57f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:27.678584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40af78-7a12-4a14-83a1-0b38cfc40776 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:27.753089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf600b0-50de-40c9-af8a-e11b3726e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:27.754131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf600b0-50de-40c9-af8a-e11b3726e618 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:27.754599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf600b0-50de-40c9-af8a-e11b3726e618 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:27.755072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf600b0-50de-40c9-af8a-e11b3726e618 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:27.793356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf600b0-50de-40c9-af8a-e11b3726e618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-1cf600b0-50de-40c9-af8a-e11b3726e618 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:27.808408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:27.809348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:27.810093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:27.812431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 16/31] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:27.818979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf600b0-50de-40c9-af8a-e11b3726e618 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:27.848457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776c651-5ec2-4f9f-8abf-81d56dafb57f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:27.893348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066b02-9e71-40d8-8a9e-f9d7b47daa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:27.894438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066b02-9e71-40d8-8a9e-f9d7b47daa1e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:27.894902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066b02-9e71-40d8-8a9e-f9d7b47daa1e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:27.895416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066b02-9e71-40d8-8a9e-f9d7b47daa1e None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:27.896250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5066b02-9e71-40d8-8a9e-f9d7b47daa1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:27.896817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5066b02-9e71-40d8-8a9e-f9d7b47daa1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:27.898886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5066b02-9e71-40d8-8a9e-f9d7b47daa1e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:27.917680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 16/32] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:27.918930 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066b02-9e71-40d8-8a9e-f9d7b47daa1e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:27.942926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:27.951203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf600b0-50de-40c9-af8a-e11b3726e618 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:27.989099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092de80-7b0c-42ae-917a-de0de76657c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:27.990122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092de80-7b0c-42ae-917a-de0de76657c4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:27.990592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092de80-7b0c-42ae-917a-de0de76657c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:27.991242 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092de80-7b0c-42ae-917a-de0de76657c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:27.992312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:27.992689 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092de80-7b0c-42ae-917a-de0de76657c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:27.993789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092de80-7b0c-42ae-917a-de0de76657c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:27.995863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092de80-7b0c-42ae-917a-de0de76657c4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:28.013034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 17/33] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:28.014368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092de80-7b0c-42ae-917a-de0de76657c4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:28.049950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066b02-9e71-40d8-8a9e-f9d7b47daa1e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:28.091537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b08b3-5406-4005-9c87-e579207ed611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:28.092574 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b08b3-5406-4005-9c87-e579207ed611 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:28.093115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b08b3-5406-4005-9c87-e579207ed611 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:28.093573 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b08b3-5406-4005-9c87-e579207ed611 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:28.094563 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b08b3-5406-4005-9c87-e579207ed611 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:28.096326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b08b3-5406-4005-9c87-e579207ed611 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:28.136851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092de80-7b0c-42ae-917a-de0de76657c4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:28.171724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1dd5a1-ec96-4389-aba7-156c85f6fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:28.172335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd5a1-ec96-4389-aba7-156c85f6fe45 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:28.172614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd5a1-ec96-4389-aba7-156c85f6fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:28.172912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd5a1-ec96-4389-aba7-156c85f6fe45 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:28.173585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1dd5a1-ec96-4389-aba7-156c85f6fe45 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:28.174969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1dd5a1-ec96-4389-aba7-156c85f6fe45 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:28.228418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 17/34] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Sep 16 19:12:27 2022] POST /identity/v3/roles => generated 219 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:12:28.228418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b08b3-5406-4005-9c87-e579207ed611 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:28.312963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 18/35] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Sep 16 19:12:28 2022] POST /identity/v3/roles => generated 225 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:12:28.314277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1dd5a1-ec96-4389-aba7-156c85f6fe45 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:28.342794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b08b3-5406-4005-9c87-e579207ed611 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:28.361797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:28.367327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:28.387213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454edbce-95b4-4686-8ac3-24aaf3a5ed93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:28.388200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454edbce-95b4-4686-8ac3-24aaf3a5ed93 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:28.388777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454edbce-95b4-4686-8ac3-24aaf3a5ed93 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:28.389231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454edbce-95b4-4686-8ac3-24aaf3a5ed93 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:28.390139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454edbce-95b4-4686-8ac3-24aaf3a5ed93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:28.392079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454edbce-95b4-4686-8ac3-24aaf3a5ed93 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:28.432547 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 18/36] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:12:28 2022] POST /identity/v3/projects => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:12:28.434533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e4dcb-585f-4a58-9e5b-1b13fc23148c None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:28.435029 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e4dcb-585f-4a58-9e5b-1b13fc23148c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:28.435514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e4dcb-585f-4a58-9e5b-1b13fc23148c None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:28.437678 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 19/37] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:28.439343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262045-8222-4801-8918-4eaecb6545a9 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:28.439805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262045-8222-4801-8918-4eaecb6545a9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:28.440262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262045-8222-4801-8918-4eaecb6545a9 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:28.441910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 20/38] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:28.443972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be8e6-44e4-4b81-9b0e-d67902dc3c5d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:28.444471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be8e6-44e4-4b81-9b0e-d67902dc3c5d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:28.444959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be8e6-44e4-4b81-9b0e-d67902dc3c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:28.468286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-c78be8e6-44e4-4b81-9b0e-d67902dc3c5d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:28.470215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c78be8e6-44e4-4b81-9b0e-d67902dc3c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:28.525835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1dd5a1-ec96-4389-aba7-156c85f6fe45 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:28.567346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 21/39] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:28.569458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba163be-0250-48fe-8a06-d797843162da None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:28.570126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba163be-0250-48fe-8a06-d797843162da None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:28.570243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba163be-0250-48fe-8a06-d797843162da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:28.579609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de420a-2262-4e55-b626-332dc752d591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:28.580507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de420a-2262-4e55-b626-332dc752d591 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:28.581172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de420a-2262-4e55-b626-332dc752d591 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:28.581599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de420a-2262-4e55-b626-332dc752d591 None admin] PATH_INFO: `/v3/users/0f9ac1f3ebbc4a86af050232d3157e46` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:28.584356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de420a-2262-4e55-b626-332dc752d591 None admin] RBAC: Authorizing `identity:get_user(user_id=0f9ac1f3ebbc4a86af050232d3157e46)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:28.586251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de420a-2262-4e55-b626-332dc752d591 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:28.588330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 19/40] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:28 2022] GET /identity/v3/users/0f9ac1f3ebbc4a86af050232d3157e46 => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:28.595724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-2ba163be-0250-48fe-8a06-d797843162da None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:28.598046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2ba163be-0250-48fe-8a06-d797843162da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:28.600988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de420a-2262-4e55-b626-332dc752d591 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:28.696490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 22/41] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:28.717859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:28.736230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de420a-2262-4e55-b626-332dc752d591 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:28.775524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee64f11-7820-4999-befa-77384fb47a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:28.776190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee64f11-7820-4999-befa-77384fb47a8a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:28.776510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee64f11-7820-4999-befa-77384fb47a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:28.776789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee64f11-7820-4999-befa-77384fb47a8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:28.778028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee64f11-7820-4999-befa-77384fb47a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:28.779495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee64f11-7820-4999-befa-77384fb47a8a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:28.781445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 20/42] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:28.787796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba163be-0250-48fe-8a06-d797843162da None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:28.820149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:28.870960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee64f11-7820-4999-befa-77384fb47a8a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:28.912259 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba163be-0250-48fe-8a06-d797843162da None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:28.978440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee64f11-7820-4999-befa-77384fb47a8a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:29.014450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c469-d09b-4874-b947-7fd7a259ca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:29.015075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c469-d09b-4874-b947-7fd7a259ca9f None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:29.015356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c469-d09b-4874-b947-7fd7a259ca9f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:29.015630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c469-d09b-4874-b947-7fd7a259ca9f None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:29.016314 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c469-d09b-4874-b947-7fd7a259ca9f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:29.017761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c469-d09b-4874-b947-7fd7a259ca9f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:29.035689 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 21/43] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Sep 16 19:12:28 2022] POST /identity/v3/roles => generated 223 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:12:29.036541 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c469-d09b-4874-b947-7fd7a259ca9f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:29.056911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:29.072769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e68a4-533f-4efb-b915-b07e5c81b709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:29.073283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e68a4-533f-4efb-b915-b07e5c81b709 None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:29.073554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e68a4-533f-4efb-b915-b07e5c81b709 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:29.073832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e68a4-533f-4efb-b915-b07e5c81b709 None admin] PATH_INFO: `/v3/domains/default/users/0f9ac1f3ebbc4a86af050232d3157e46/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:29.075848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e68a4-533f-4efb-b915-b07e5c81b709 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0f9ac1f3ebbc4a86af050232d3157e46, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:29.077412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e68a4-533f-4efb-b915-b07e5c81b709 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:29.104419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 23/44] 10.222.0.49 () {58 vars in 1361 bytes} [Fri Sep 16 19:12:28 2022] PUT /identity/v3/domains/default/users/0f9ac1f3ebbc4a86af050232d3157e46/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:12:29.163305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c469-d09b-4874-b947-7fd7a259ca9f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:29.204291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f920cd-aa7d-4f32-aaa3-1d29d7c4db30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:29.205002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f920cd-aa7d-4f32-aaa3-1d29d7c4db30 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:29.205288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f920cd-aa7d-4f32-aaa3-1d29d7c4db30 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:29.205564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f920cd-aa7d-4f32-aaa3-1d29d7c4db30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:29.206818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f920cd-aa7d-4f32-aaa3-1d29d7c4db30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:29.208348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f920cd-aa7d-4f32-aaa3-1d29d7c4db30 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:29.210288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 22/45] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:29.216142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e68a4-533f-4efb-b915-b07e5c81b709 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:29.319092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:29.332296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e68a4-533f-4efb-b915-b07e5c81b709 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:29.366314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e62344-2e66-45db-8a93-c1456736fc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:29.367020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62344-2e66-45db-8a93-c1456736fc43 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:29.367302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62344-2e66-45db-8a93-c1456736fc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:29.367600 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62344-2e66-45db-8a93-c1456736fc43 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:29.368273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e62344-2e66-45db-8a93-c1456736fc43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:29.369762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e62344-2e66-45db-8a93-c1456736fc43 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:29.397116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:12:29 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:12:31.308886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6395e6-328c-482c-b0c4-4393d0bcf7b9 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:31.309432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6395e6-328c-482c-b0c4-4393d0bcf7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:31.309432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6395e6-328c-482c-b0c4-4393d0bcf7b9 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:31.310819 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 23/47] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:31.316241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2edaec-1266-47c1-a272-d50c10e210e6 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:31.316681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2edaec-1266-47c1-a272-d50c10e210e6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:31.316839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2edaec-1266-47c1-a272-d50c10e210e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:31.337390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ae2edaec-1266-47c1-a272-d50c10e210e6 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:31.338592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ae2edaec-1266-47c1-a272-d50c10e210e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:31.411202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 25/48] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:31.538118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007eada-44da-4dda-9dad-10e71a6d1147 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:31.538354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007eada-44da-4dda-9dad-10e71a6d1147 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:31.538759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007eada-44da-4dda-9dad-10e71a6d1147 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:31.540146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 24/49] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:31.545670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c6c0-d99c-45c0-90c3-8b8723e3948b None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:31.545965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c6c0-d99c-45c0-90c3-8b8723e3948b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:31.546247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c6c0-d99c-45c0-90c3-8b8723e3948b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:31.565901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d888c6c0-d99c-45c0-90c3-8b8723e3948b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:31.567034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d888c6c0-d99c-45c0-90c3-8b8723e3948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:31.651029 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:31.657984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 26/50] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:31.683343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007eada-44da-4dda-9dad-10e71a6d1147 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:31.788812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:31.814939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007eada-44da-4dda-9dad-10e71a6d1147 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:31.855854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd57e1-9590-4b6c-9d20-0fbb9db5c6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:31.856414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd57e1-9590-4b6c-9d20-0fbb9db5c6fc None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:31.856727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd57e1-9590-4b6c-9d20-0fbb9db5c6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:31.857004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd57e1-9590-4b6c-9d20-0fbb9db5c6fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:31.871651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd57e1-9590-4b6c-9d20-0fbb9db5c6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-0efd57e1-9590-4b6c-9d20-0fbb9db5c6fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:31.878775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:31.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:31.880422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 25/51] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:12:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:31.886714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c6c0-d99c-45c0-90c3-8b8723e3948b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:31.997279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd57e1-9590-4b6c-9d20-0fbb9db5c6fc None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:32.002643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c6c0-d99c-45c0-90c3-8b8723e3948b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:32.050391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ec264-7e12-463d-89d0-cbd45d467c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:32.051022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ec264-7e12-463d-89d0-cbd45d467c83 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:32.051308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ec264-7e12-463d-89d0-cbd45d467c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:32.051584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ec264-7e12-463d-89d0-cbd45d467c83 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:32.052274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ec264-7e12-463d-89d0-cbd45d467c83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:32.052611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ec264-7e12-463d-89d0-cbd45d467c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:32.054010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ec264-7e12-463d-89d0-cbd45d467c83 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:32.063384 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 27/52] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:32.069235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ec264-7e12-463d-89d0-cbd45d467c83 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:32.122300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd57e1-9590-4b6c-9d20-0fbb9db5c6fc None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:32.146842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:32.158719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221988a-6c20-42ce-a2b9-8f3108a81a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:32.159365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221988a-6c20-42ce-a2b9-8f3108a81a8a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:32.159646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221988a-6c20-42ce-a2b9-8f3108a81a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:32.159912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221988a-6c20-42ce-a2b9-8f3108a81a8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:32.161087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221988a-6c20-42ce-a2b9-8f3108a81a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:32.162552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221988a-6c20-42ce-a2b9-8f3108a81a8a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:32.164197 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:32.169775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221988a-6c20-42ce-a2b9-8f3108a81a8a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:32.204590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ec264-7e12-463d-89d0-cbd45d467c83 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:32.257727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d642d-0366-4968-a2a0-a38be612c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:32.262311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d642d-0366-4968-a2a0-a38be612c98a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:32.262599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d642d-0366-4968-a2a0-a38be612c98a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:32.262878 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d642d-0366-4968-a2a0-a38be612c98a None admin] PATH_INFO: `/v3/users/0f9ac1f3ebbc4a86af050232d3157e46` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:32.264341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d642d-0366-4968-a2a0-a38be612c98a None admin] RBAC: Authorizing `identity:get_user(user_id=0f9ac1f3ebbc4a86af050232d3157e46)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:32.265930 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d642d-0366-4968-a2a0-a38be612c98a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:32.267589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 28/54] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:32 2022] GET /identity/v3/users/0f9ac1f3ebbc4a86af050232d3157e46 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:32.275009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d642d-0366-4968-a2a0-a38be612c98a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:32.295726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:32.400011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d642d-0366-4968-a2a0-a38be612c98a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:32.409273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221988a-6c20-42ce-a2b9-8f3108a81a8a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:32.432979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:32.439636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dc229-febe-4a04-8d9a-72519aaf37cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:32.440282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dc229-febe-4a04-8d9a-72519aaf37cd None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:32.440590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dc229-febe-4a04-8d9a-72519aaf37cd None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:32.440870 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dc229-febe-4a04-8d9a-72519aaf37cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:32.441978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dc229-febe-4a04-8d9a-72519aaf37cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:32.443435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dc229-febe-4a04-8d9a-72519aaf37cd None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:32.445194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 29/55] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:32.449530 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074fe0e-af0b-4e33-be86-3130356b3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:32.450149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074fe0e-af0b-4e33-be86-3130356b3d85 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:32.450433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074fe0e-af0b-4e33-be86-3130356b3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:32.450731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074fe0e-af0b-4e33-be86-3130356b3d85 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:32.451403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dc229-febe-4a04-8d9a-72519aaf37cd None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:32.451506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074fe0e-af0b-4e33-be86-3130356b3d85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:32.452896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074fe0e-af0b-4e33-be86-3130356b3d85 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:32.484455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 27/56] 10.222.0.49 () {60 vars in 1140 bytes} [Fri Sep 16 19:12:32 2022] POST /identity/v3/projects => generated 298 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:12:32.560547 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dc229-febe-4a04-8d9a-72519aaf37cd None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:32.598161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948880-dd6e-4086-a783-cd3d473db053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:32.598780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948880-dd6e-4086-a783-cd3d473db053 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:32.599058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948880-dd6e-4086-a783-cd3d473db053 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:32.599328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948880-dd6e-4086-a783-cd3d473db053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:32.600053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92948880-dd6e-4086-a783-cd3d473db053 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.domain.id=default, user.id=0f9ac1f3ebbc4a86af050232d3157e46) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:32.600354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92948880-dd6e-4086-a783-cd3d473db053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:32.601935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92948880-dd6e-4086-a783-cd3d473db053 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:32.608895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 30/57] 10.222.0.49 () {56 vars in 1322 bytes} [Fri Sep 16 19:12:32 2022] GET /identity/v3/role_assignments?user.id=0f9ac1f3ebbc4a86af050232d3157e46&scope.domain.id=default&role.id=71bed99a52684ba990097719b40ef99d => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:34.632731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773558-927c-40be-afc7-7d5ea7c58b66 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:34.633293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773558-927c-40be-afc7-7d5ea7c58b66 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:34.633293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773558-927c-40be-afc7-7d5ea7c58b66 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:34.634517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 28/58] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:34.640890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee35155-3a25-4665-9349-a3784695babf None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:34.641617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee35155-3a25-4665-9349-a3784695babf None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:34.641757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee35155-3a25-4665-9349-a3784695babf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:34.669333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-bee35155-3a25-4665-9349-a3784695babf None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:34.670531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-bee35155-3a25-4665-9349-a3784695babf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:34.731754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:34.743865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 31/59] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:35.013494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e773558-927c-40be-afc7-7d5ea7c58b66 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:35.087364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:35.134463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e773558-927c-40be-afc7-7d5ea7c58b66 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:35.168542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fce57b-687b-44ff-9fa8-f3d64a0fa668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:35.169166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fce57b-687b-44ff-9fa8-f3d64a0fa668 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:35.169446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fce57b-687b-44ff-9fa8-f3d64a0fa668 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:35.169719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fce57b-687b-44ff-9fa8-f3d64a0fa668 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:35.170906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fce57b-687b-44ff-9fa8-f3d64a0fa668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:35.172353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fce57b-687b-44ff-9fa8-f3d64a0fa668 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:35.173931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 29/60] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:35.181870 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee35155-3a25-4665-9349-a3784695babf None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:35.295896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee35155-3a25-4665-9349-a3784695babf None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:35.330278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfdf50-64de-4008-b3d0-5dd037efbc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:35.330877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfdf50-64de-4008-b3d0-5dd037efbc26 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:35.331156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfdf50-64de-4008-b3d0-5dd037efbc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:35.331428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfdf50-64de-4008-b3d0-5dd037efbc26 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:35.332083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfdf50-64de-4008-b3d0-5dd037efbc26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:35.333715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfdf50-64de-4008-b3d0-5dd037efbc26 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:35.362551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 32/61] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:12:35 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:12:38.539616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b670e-06c5-4c61-871e-24c936ac4f1c None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:38.540175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b670e-06c5-4c61-871e-24c936ac4f1c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:38.540175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b670e-06c5-4c61-871e-24c936ac4f1c None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:38.541548 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 30/62] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:38.558073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b130-4b43-40ea-84b5-6fc488f08644 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:38.558543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b130-4b43-40ea-84b5-6fc488f08644 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:38.558615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b130-4b43-40ea-84b5-6fc488f08644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:38.581475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1346b130-4b43-40ea-84b5-6fc488f08644 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:38.582724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1346b130-4b43-40ea-84b5-6fc488f08644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:38.640664 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:38.682047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 33/63] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:38.826658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aada4-0dcd-41e0-b71d-08a7f2df39f9 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:38.827280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aada4-0dcd-41e0-b71d-08a7f2df39f9 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:38.827750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aada4-0dcd-41e0-b71d-08a7f2df39f9 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:38.829361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 31/64] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:38.835372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e88b3-79fd-43b5-bc66-ef9c94c2badf None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:38.836287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e88b3-79fd-43b5-bc66-ef9c94c2badf None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:38.836287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e88b3-79fd-43b5-bc66-ef9c94c2badf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:38.869760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-cb2e88b3-79fd-43b5-bc66-ef9c94c2badf None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:38.871014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cb2e88b3-79fd-43b5-bc66-ef9c94c2badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:38.961290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 34/65] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:38.973164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aada4-0dcd-41e0-b71d-08a7f2df39f9 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:38.977728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc4519-88b4-4a5a-bc0a-124316262d03 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:38.978246 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc4519-88b4-4a5a-bc0a-124316262d03 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:38.978655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc4519-88b4-4a5a-bc0a-124316262d03 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:38.980196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 35/66] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:12:38.985513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38e5ac-e6e3-4d4c-b793-a50e58b2f06f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:38.985984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38e5ac-e6e3-4d4c-b793-a50e58b2f06f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:38.986409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38e5ac-e6e3-4d4c-b793-a50e58b2f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.013006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3c38e5ac-e6e3-4d4c-b793-a50e58b2f06f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:39.014437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3c38e5ac-e6e3-4d4c-b793-a50e58b2f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:39.119172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 36/67] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:39.181163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aada4-0dcd-41e0-b71d-08a7f2df39f9 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:39.224763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:39.234983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747464ae-7f32-45e3-ac31-a4a49ff4da45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:39.235640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747464ae-7f32-45e3-ac31-a4a49ff4da45 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.235922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747464ae-7f32-45e3-ac31-a4a49ff4da45 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.236202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747464ae-7f32-45e3-ac31-a4a49ff4da45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.252410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747464ae-7f32-45e3-ac31-a4a49ff4da45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-747464ae-7f32-45e3-ac31-a4a49ff4da45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:39.257351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:39.258166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:39.258917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 32/68] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:39.264180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38e5ac-e6e3-4d4c-b793-a50e58b2f06f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:39.271127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747464ae-7f32-45e3-ac31-a4a49ff4da45 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:39.316454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:39.415848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38e5ac-e6e3-4d4c-b793-a50e58b2f06f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:39.445609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747464ae-7f32-45e3-ac31-a4a49ff4da45 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:39.455092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3813d-70a3-4c9e-a168-1e8bcd367451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:39.455744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3813d-70a3-4c9e-a168-1e8bcd367451 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.456024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3813d-70a3-4c9e-a168-1e8bcd367451 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.456301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3813d-70a3-4c9e-a168-1e8bcd367451 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.476448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3813d-70a3-4c9e-a168-1e8bcd367451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-5ea3813d-70a3-4c9e-a168-1e8bcd367451 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:39.482805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:39.483676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:39.484475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:39.485055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 37/69] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:39.485577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3813d-70a3-4c9e-a168-1e8bcd367451 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:39.500239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb47597-959f-43bc-8203-f0171a424e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:39.501421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb47597-959f-43bc-8203-f0171a424e44 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.501754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb47597-959f-43bc-8203-f0171a424e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.502033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb47597-959f-43bc-8203-f0171a424e44 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.503379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb47597-959f-43bc-8203-f0171a424e44 None admin] RBAC: Adding query filter params (name=member) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:39.503695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb47597-959f-43bc-8203-f0171a424e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:39.505097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb47597-959f-43bc-8203-f0171a424e44 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:39.515702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 33/70] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:12:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:39.520619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb47597-959f-43bc-8203-f0171a424e44 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:39.575406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:39.591378 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:39.595368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3813d-70a3-4c9e-a168-1e8bcd367451 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:39.625103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb47597-959f-43bc-8203-f0171a424e44 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:39.628558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ffda8-ceef-446c-8831-fbe72250496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:39.629211 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ffda8-ceef-446c-8831-fbe72250496f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.629494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ffda8-ceef-446c-8831-fbe72250496f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.629769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ffda8-ceef-446c-8831-fbe72250496f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.639849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ffda8-ceef-446c-8831-fbe72250496f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-c89ffda8-ceef-446c-8831-fbe72250496f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:39.644794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:39.645656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:39.646422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 38/71] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:12:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:39.647140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ffda8-ceef-446c-8831-fbe72250496f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:39.660833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a688cf-c447-4b0c-941c-71973f2ccea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:39.661462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a688cf-c447-4b0c-941c-71973f2ccea9 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.661748 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a688cf-c447-4b0c-941c-71973f2ccea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.662032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a688cf-c447-4b0c-941c-71973f2ccea9 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.662889 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a688cf-c447-4b0c-941c-71973f2ccea9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:39.663590 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a688cf-c447-4b0c-941c-71973f2ccea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:39.665050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a688cf-c447-4b0c-941c-71973f2ccea9 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:39.673784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 34/72] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:39.674892 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372627-72d0-4899-8e84-bc3469cb0fdc None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.675381 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372627-72d0-4899-8e84-bc3469cb0fdc None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.675661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372627-72d0-4899-8e84-bc3469cb0fdc None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.677061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 35/73] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:39.681542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18d72-065c-499e-9cc4-367b0e328963 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.681824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18d72-065c-499e-9cc4-367b0e328963 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.682097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18d72-065c-499e-9cc4-367b0e328963 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.684369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 36/74] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:39.685103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18d72-065c-499e-9cc4-367b0e328963 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:39.748451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ffda8-ceef-446c-8831-fbe72250496f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:39.786627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c83e1-93c5-4b80-aeeb-183e18a55195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:39.787273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c83e1-93c5-4b80-aeeb-183e18a55195 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.787552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c83e1-93c5-4b80-aeeb-183e18a55195 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.787824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c83e1-93c5-4b80-aeeb-183e18a55195 None admin] PATH_INFO: `/v3/users/c60ac1ea012749b8837fa25f6f407f9c` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.798991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18d72-065c-499e-9cc4-367b0e328963 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:39.801645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c83e1-93c5-4b80-aeeb-183e18a55195 None admin] RBAC: Authorizing `identity:get_user(user_id=c60ac1ea012749b8837fa25f6f407f9c)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:39.803146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c83e1-93c5-4b80-aeeb-183e18a55195 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:39.804920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 39/75] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:39 2022] GET /identity/v3/users/c60ac1ea012749b8837fa25f6f407f9c => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:39.805702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c83e1-93c5-4b80-aeeb-183e18a55195 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:39.817062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:39.823975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:39.840162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf30716-fbb2-4903-a14d-15777126b42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:39.840836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf30716-fbb2-4903-a14d-15777126b42f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.841113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf30716-fbb2-4903-a14d-15777126b42f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.841385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf30716-fbb2-4903-a14d-15777126b42f None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.842753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf30716-fbb2-4903-a14d-15777126b42f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:39.842753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf30716-fbb2-4903-a14d-15777126b42f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:39.843709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf30716-fbb2-4903-a14d-15777126b42f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:39.852476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 37/76] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:12:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:39.854047 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe11641-10a9-48a2-9cad-2590bf98b150 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.854047 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe11641-10a9-48a2-9cad-2590bf98b150 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.854299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe11641-10a9-48a2-9cad-2590bf98b150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.872526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-5fe11641-10a9-48a2-9cad-2590bf98b150 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:39.874061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5fe11641-10a9-48a2-9cad-2590bf98b150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:39.905788 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c83e1-93c5-4b80-aeeb-183e18a55195 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:39.940315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839895e5-730f-4937-add9-40851e39a922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:39.940499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 38/77] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:39.940924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839895e5-730f-4937-add9-40851e39a922 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.941205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839895e5-730f-4937-add9-40851e39a922 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.941482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839895e5-730f-4937-add9-40851e39a922 None admin] PATH_INFO: `/v3/users/0f9ac1f3ebbc4a86af050232d3157e46` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.941660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cb63b-3193-4b2f-8ceb-afc050f4d1ee None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.941943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cb63b-3193-4b2f-8ceb-afc050f4d1ee None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.942213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cb63b-3193-4b2f-8ceb-afc050f4d1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.942747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839895e5-730f-4937-add9-40851e39a922 None admin] RBAC: Authorizing `identity:get_user(user_id=0f9ac1f3ebbc4a86af050232d3157e46)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:39.944330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839895e5-730f-4937-add9-40851e39a922 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:39.946297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 40/78] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:39 2022] GET /identity/v3/users/0f9ac1f3ebbc4a86af050232d3157e46 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:39.949224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839895e5-730f-4937-add9-40851e39a922 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:39.969368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f85cb63b-3193-4b2f-8ceb-afc050f4d1ee None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:39.970563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f85cb63b-3193-4b2f-8ceb-afc050f4d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:40.037843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 39/79] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:40.039178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cb63b-3193-4b2f-8ceb-afc050f4d1ee None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.048941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:40.055452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839895e5-730f-4937-add9-40851e39a922 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:40.090560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:40.094124 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2c6b-780b-436e-adef-82d432c78d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:40.094845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2c6b-780b-436e-adef-82d432c78d47 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:40.095205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2c6b-780b-436e-adef-82d432c78d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:40.095546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2c6b-780b-436e-adef-82d432c78d47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:40.173306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2c6b-780b-436e-adef-82d432c78d47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:40.174984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2c6b-780b-436e-adef-82d432c78d47 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:40.178799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cb63b-3193-4b2f-8ceb-afc050f4d1ee None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:40.217609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1988c6b-f5a3-4853-a70d-552f0e2f2299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:40.218292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1988c6b-f5a3-4853-a70d-552f0e2f2299 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:40.218582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1988c6b-f5a3-4853-a70d-552f0e2f2299 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:40.219167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1988c6b-f5a3-4853-a70d-552f0e2f2299 None admin] PATH_INFO: `/v3/users/c60ac1ea012749b8837fa25f6f407f9c` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:40.220415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1988c6b-f5a3-4853-a70d-552f0e2f2299 None admin] RBAC: Authorizing `identity:get_user(user_id=c60ac1ea012749b8837fa25f6f407f9c)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:40.221864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1988c6b-f5a3-4853-a70d-552f0e2f2299 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:40.223595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 40/80] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/users/c60ac1ea012749b8837fa25f6f407f9c => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:40.224559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1988c6b-f5a3-4853-a70d-552f0e2f2299 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.265736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:40.284424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 41/81] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:40.285565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2c6b-780b-436e-adef-82d432c78d47 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.333745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1988c6b-f5a3-4853-a70d-552f0e2f2299 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:40.336255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:40.368915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcebd5-c863-4046-b90e-77b8ac2ee143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:40.369526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcebd5-c863-4046-b90e-77b8ac2ee143 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:40.369810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcebd5-c863-4046-b90e-77b8ac2ee143 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:40.370085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcebd5-c863-4046-b90e-77b8ac2ee143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:40.387919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2c6b-780b-436e-adef-82d432c78d47 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:40.422321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2a5b3-35a6-4346-98d6-7233160e7df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:40.422952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2a5b3-35a6-4346-98d6-7233160e7df7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:40.423237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2a5b3-35a6-4346-98d6-7233160e7df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:40.423514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2a5b3-35a6-4346-98d6-7233160e7df7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:40.433911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2a5b3-35a6-4346-98d6-7233160e7df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:40.437500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcebd5-c863-4046-b90e-77b8ac2ee143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-fbe2a5b3-35a6-4346-98d6-7233160e7df7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:40.438811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:40.439727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:40.440537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:40.441117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcebd5-c863-4046-b90e-77b8ac2ee143 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:40.441188 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 42/82] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:40.445902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2a5b3-35a6-4346-98d6-7233160e7df7 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.492525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:40.540177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 41/83] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:40.541074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcebd5-c863-4046-b90e-77b8ac2ee143 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.546645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:40.548189 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2a5b3-35a6-4346-98d6-7233160e7df7 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:40.585401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636621-60ed-4265-815b-c92510dfb1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:40.586022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636621-60ed-4265-815b-c92510dfb1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:40.586310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636621-60ed-4265-815b-c92510dfb1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:40.586584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636621-60ed-4265-815b-c92510dfb1c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:40.642641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcebd5-c863-4046-b90e-77b8ac2ee143 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:40.652275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3636621-60ed-4265-815b-c92510dfb1c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:40.653803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3636621-60ed-4265-815b-c92510dfb1c0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:40.676577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43feb8-9959-432f-adf4-d02bd0e762c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:40.677220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43feb8-9959-432f-adf4-d02bd0e762c3 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:40.677505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43feb8-9959-432f-adf4-d02bd0e762c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:40.677785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43feb8-9959-432f-adf4-d02bd0e762c3 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:40.678960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43feb8-9959-432f-adf4-d02bd0e762c3 None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:40.680431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43feb8-9959-432f-adf4-d02bd0e762c3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:40.682122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 42/84] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:40.682887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43feb8-9959-432f-adf4-d02bd0e762c3 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.697892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:40.751737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:40.755393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 43/85] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:40.756265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636621-60ed-4265-815b-c92510dfb1c0 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.787248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43feb8-9959-432f-adf4-d02bd0e762c3 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:40.821527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9e650-1065-4409-bb9e-13768505e87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:40.822998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9e650-1065-4409-bb9e-13768505e87a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:40.823287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9e650-1065-4409-bb9e-13768505e87a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:40.823702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9e650-1065-4409-bb9e-13768505e87a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:40.824870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9e650-1065-4409-bb9e-13768505e87a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:40.826324 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9e650-1065-4409-bb9e-13768505e87a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:40.827918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 43/86] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:40.828712 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9e650-1065-4409-bb9e-13768505e87a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.858517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636621-60ed-4265-815b-c92510dfb1c0 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:40.892231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a944a1d-08d2-45cb-9eef-ea84887f45c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:40.892868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a944a1d-08d2-45cb-9eef-ea84887f45c1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:40.893149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a944a1d-08d2-45cb-9eef-ea84887f45c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:40.893509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a944a1d-08d2-45cb-9eef-ea84887f45c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:40.894220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a944a1d-08d2-45cb-9eef-ea84887f45c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:40.894528 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a944a1d-08d2-45cb-9eef-ea84887f45c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:40.895921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a944a1d-08d2-45cb-9eef-ea84887f45c1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:40.904276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 44/87] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:40.905089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a944a1d-08d2-45cb-9eef-ea84887f45c1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.914045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:40.930121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9e650-1065-4409-bb9e-13768505e87a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:40.964000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a036bd2-9079-4255-82f1-c769a1ae43f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:40.964673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a036bd2-9079-4255-82f1-c769a1ae43f2 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:40.964957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a036bd2-9079-4255-82f1-c769a1ae43f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:40.965232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a036bd2-9079-4255-82f1-c769a1ae43f2 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:40.966388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a036bd2-9079-4255-82f1-c769a1ae43f2 None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:40.967830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a036bd2-9079-4255-82f1-c769a1ae43f2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:40.969659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 44/88] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:40.970326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a036bd2-9079-4255-82f1-c769a1ae43f2 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.980615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:41.007874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a944a1d-08d2-45cb-9eef-ea84887f45c1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:41.041685 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8759b-31f8-482a-8ea7-fb45391802b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:41.042290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8759b-31f8-482a-8ea7-fb45391802b4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:41.042567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8759b-31f8-482a-8ea7-fb45391802b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:41.042841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8759b-31f8-482a-8ea7-fb45391802b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:41.043565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8759b-31f8-482a-8ea7-fb45391802b4 None admin] RBAC: Adding query filter params (role.id=4debeb1d97ca4a77afef4ab92d134846, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user.id=c60ac1ea012749b8837fa25f6f407f9c) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:41.043872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8759b-31f8-482a-8ea7-fb45391802b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:41.045365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8759b-31f8-482a-8ea7-fb45391802b4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:41.050626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 45/89] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/role_assignments?user.id=c60ac1ea012749b8837fa25f6f407f9c&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:41.051371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8759b-31f8-482a-8ea7-fb45391802b4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:41.073873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a036bd2-9079-4255-82f1-c769a1ae43f2 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:41.114444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1e934-26c6-444a-a585-dd58f6a3b32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:41.115112 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1e934-26c6-444a-a585-dd58f6a3b32c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:41.115462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1e934-26c6-444a-a585-dd58f6a3b32c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:41.115840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1e934-26c6-444a-a585-dd58f6a3b32c None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:41.117372 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1e934-26c6-444a-a585-dd58f6a3b32c None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:41.119016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1e934-26c6-444a-a585-dd58f6a3b32c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:41.121231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 45/90] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:41.121974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1e934-26c6-444a-a585-dd58f6a3b32c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:41.140880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:41.174373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8759b-31f8-482a-8ea7-fb45391802b4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:41.209838 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:41.213018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f86a67-16a1-49c4-b46e-f9b0415a0112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:41.213767 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86a67-16a1-49c4-b46e-f9b0415a0112 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:41.214054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86a67-16a1-49c4-b46e-f9b0415a0112 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:41.214336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86a67-16a1-49c4-b46e-f9b0415a0112 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:41.215075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f86a67-16a1-49c4-b46e-f9b0415a0112 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:41.216621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f86a67-16a1-49c4-b46e-f9b0415a0112 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:41.238171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1e934-26c6-444a-a585-dd58f6a3b32c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:41.241345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 46/91] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:12:41 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:12:41.242498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f86a67-16a1-49c4-b46e-f9b0415a0112 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:41.296160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384de9-da5b-40ad-9d1a-aa54153caac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:41.298258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384de9-da5b-40ad-9d1a-aa54153caac0 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:41.298749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384de9-da5b-40ad-9d1a-aa54153caac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:41.299201 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384de9-da5b-40ad-9d1a-aa54153caac0 None admin] PATH_INFO: `/v3/users/c60ac1ea012749b8837fa25f6f407f9c` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:41.300869 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384de9-da5b-40ad-9d1a-aa54153caac0 None admin] RBAC: Authorizing `identity:get_user(user_id=c60ac1ea012749b8837fa25f6f407f9c)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:41.302682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384de9-da5b-40ad-9d1a-aa54153caac0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:41.307327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 46/92] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:41 2022] GET /identity/v3/users/c60ac1ea012749b8837fa25f6f407f9c => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:41.309026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384de9-da5b-40ad-9d1a-aa54153caac0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:41.392679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f86a67-16a1-49c4-b46e-f9b0415a0112 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:41.432027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:41.441968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384de9-da5b-40ad-9d1a-aa54153caac0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:41.443155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65fbee-7f33-4a94-a03d-e1a1476d9931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:41.443959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65fbee-7f33-4a94-a03d-e1a1476d9931 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:41.444551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65fbee-7f33-4a94-a03d-e1a1476d9931 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:41.448886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65fbee-7f33-4a94-a03d-e1a1476d9931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:41.449710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65fbee-7f33-4a94-a03d-e1a1476d9931 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user.id=0f9ac1f3ebbc4a86af050232d3157e46) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:41.450057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65fbee-7f33-4a94-a03d-e1a1476d9931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:41.452233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65fbee-7f33-4a94-a03d-e1a1476d9931 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:41.460540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 47/93] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:41 2022] GET /identity/v3/role_assignments?user.id=0f9ac1f3ebbc4a86af050232d3157e46&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=71bed99a52684ba990097719b40ef99d => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:41.464324 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65fbee-7f33-4a94-a03d-e1a1476d9931 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:41.495142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d9851-da8f-4c02-ac04-26d46f29d5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:41.495994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d9851-da8f-4c02-ac04-26d46f29d5ca None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:41.496279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d9851-da8f-4c02-ac04-26d46f29d5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:41.496591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d9851-da8f-4c02-ac04-26d46f29d5ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:41.498074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d9851-da8f-4c02-ac04-26d46f29d5ca None admin] RBAC: Adding query filter params (role.id=e157fabaf96640bf8a975076a70c720d, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user.id=c60ac1ea012749b8837fa25f6f407f9c) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:41.498394 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d9851-da8f-4c02-ac04-26d46f29d5ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:41.499892 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d9851-da8f-4c02-ac04-26d46f29d5ca None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:41.511014 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 47/94] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:41 2022] GET /identity/v3/role_assignments?user.id=c60ac1ea012749b8837fa25f6f407f9c&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=e157fabaf96640bf8a975076a70c720d => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:41.601021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65fbee-7f33-4a94-a03d-e1a1476d9931 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:41.652346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e739-2764-484f-b54e-a053f50b62a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:41.653053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e739-2764-484f-b54e-a053f50b62a7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:41.653321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e739-2764-484f-b54e-a053f50b62a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:41.653600 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e739-2764-484f-b54e-a053f50b62a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:41.725973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:41.738728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e739-2764-484f-b54e-a053f50b62a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:41.740241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e739-2764-484f-b54e-a053f50b62a7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:41.858093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 48/95] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:41.863339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d9851-da8f-4c02-ac04-26d46f29d5ca None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:41.875628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:41.972040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d9851-da8f-4c02-ac04-26d46f29d5ca None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:42.007912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d89178-9e04-4a74-b49e-c8b981c194c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:42.008605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89178-9e04-4a74-b49e-c8b981c194c2 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:42.008891 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89178-9e04-4a74-b49e-c8b981c194c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:42.009170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89178-9e04-4a74-b49e-c8b981c194c2 None admin] PATH_INFO: `/v3/projects/e1a27c58f1014fef96de0c567dd4f420` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:42.010334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d89178-9e04-4a74-b49e-c8b981c194c2 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a27c58f1014fef96de0c567dd4f420)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:42.011923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d89178-9e04-4a74-b49e-c8b981c194c2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:42.013788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 48/96] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:41 2022] GET /identity/v3/projects/e1a27c58f1014fef96de0c567dd4f420 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:42.019993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e739-2764-484f-b54e-a053f50b62a7 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:42.125966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:42.135366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e739-2764-484f-b54e-a053f50b62a7 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:42.196522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c59750-71bf-4bad-86ae-573d3c8d6f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:42.197823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59750-71bf-4bad-86ae-573d3c8d6f1f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:42.198267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59750-71bf-4bad-86ae-573d3c8d6f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:42.198701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59750-71bf-4bad-86ae-573d3c8d6f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:42.199615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c59750-71bf-4bad-86ae-573d3c8d6f1f None admin] RBAC: Adding query filter params (role.id=4debeb1d97ca4a77afef4ab92d134846, scope.project.id=e1a27c58f1014fef96de0c567dd4f420, user.id=c60ac1ea012749b8837fa25f6f407f9c) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:42.200086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c59750-71bf-4bad-86ae-573d3c8d6f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:42.201736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c59750-71bf-4bad-86ae-573d3c8d6f1f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:42.212960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 49/97] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:42 2022] GET /identity/v3/role_assignments?user.id=c60ac1ea012749b8837fa25f6f407f9c&scope.project.id=e1a27c58f1014fef96de0c567dd4f420&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:43.763022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73b7d8-adfc-47be-a69c-f7a932bfbf02 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:43.763785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73b7d8-adfc-47be-a69c-f7a932bfbf02 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:43.763785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73b7d8-adfc-47be-a69c-f7a932bfbf02 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:43.764990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 49/98] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:43.782326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d8997-0651-4b8c-87cd-07146a673d74 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:43.783197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d8997-0651-4b8c-87cd-07146a673d74 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:43.783662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d8997-0651-4b8c-87cd-07146a673d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:43.809400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-340d8997-0651-4b8c-87cd-07146a673d74 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:43.810945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-340d8997-0651-4b8c-87cd-07146a673d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:43.896065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 50/99] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:44.438227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73b7d8-adfc-47be-a69c-f7a932bfbf02 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:44.524422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:44.554237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73b7d8-adfc-47be-a69c-f7a932bfbf02 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:44.593824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86b0f9-dbe6-4d97-8b47-edf63a3da79c None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:44.594131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86b0f9-dbe6-4d97-8b47-edf63a3da79c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:44.594379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86b0f9-dbe6-4d97-8b47-edf63a3da79c None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:44.595969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 51/100] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:44.601026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c1dc9-ff26-45ce-bb29-856a36dc08c9 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:44.601317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c1dc9-ff26-45ce-bb29-856a36dc08c9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:44.601584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c1dc9-ff26-45ce-bb29-856a36dc08c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:44.621952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a269d-3b56-4ea6-8528-3f731fe85d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:44.622609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a269d-3b56-4ea6-8528-3f731fe85d35 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:44.622886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a269d-3b56-4ea6-8528-3f731fe85d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:44.623156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a269d-3b56-4ea6-8528-3f731fe85d35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:44.627330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d44c1dc9-ff26-45ce-bb29-856a36dc08c9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:44.629529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d44c1dc9-ff26-45ce-bb29-856a36dc08c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:44.648537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a269d-3b56-4ea6-8528-3f731fe85d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-7e8a269d-3b56-4ea6-8528-3f731fe85d35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:44.653999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:44.654933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:44.655677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 50/101] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:44.660734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc09e-97ea-45f6-891f-5e7d1a28464e None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:44.661016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc09e-97ea-45f6-891f-5e7d1a28464e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:44.661288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc09e-97ea-45f6-891f-5e7d1a28464e None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:44.662624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 51/102] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:44.664256 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfc09e-97ea-45f6-891f-5e7d1a28464e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:44.753545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 52/103] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:12:44.754695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34005b-25bf-49c7-bec2-b15ff647016e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:44.755005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34005b-25bf-49c7-bec2-b15ff647016e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:44.755257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34005b-25bf-49c7-bec2-b15ff647016e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:44.790452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-7c34005b-25bf-49c7-bec2-b15ff647016e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:44.791651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7c34005b-25bf-49c7-bec2-b15ff647016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:44.816758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:44.861060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfc09e-97ea-45f6-891f-5e7d1a28464e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:44.918642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 53/104] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:44.921061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d08d3-08f7-4045-81cb-49529c3c75d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:44.921689 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d08d3-08f7-4045-81cb-49529c3c75d1 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:44.921967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d08d3-08f7-4045-81cb-49529c3c75d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:44.922238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d08d3-08f7-4045-81cb-49529c3c75d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:44.922911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d08d3-08f7-4045-81cb-49529c3c75d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:44.923212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d08d3-08f7-4045-81cb-49529c3c75d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:44.924640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d08d3-08f7-4045-81cb-49529c3c75d1 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:44.927085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:44.935316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 52/105] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:12:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:44.941418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34005b-25bf-49c7-bec2-b15ff647016e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:45.090203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34005b-25bf-49c7-bec2-b15ff647016e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:45.121466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d08d3-08f7-4045-81cb-49529c3c75d1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:45.146992 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37814e8-6c11-4856-9c40-76eb12b9c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:45.147731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37814e8-6c11-4856-9c40-76eb12b9c627 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.148952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37814e8-6c11-4856-9c40-76eb12b9c627 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.149243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37814e8-6c11-4856-9c40-76eb12b9c627 None admin] PATH_INFO: `/v3/users/c60ac1ea012749b8837fa25f6f407f9c` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.152993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37814e8-6c11-4856-9c40-76eb12b9c627 None admin] RBAC: Authorizing `identity:get_user(user_id=c60ac1ea012749b8837fa25f6f407f9c)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:45.154440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37814e8-6c11-4856-9c40-76eb12b9c627 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:45.157612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 54/106] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:44 2022] GET /identity/v3/users/c60ac1ea012749b8837fa25f6f407f9c => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:45.158560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589f127-7fb6-459d-af5e-550bbb6a2bd6 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.158837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589f127-7fb6-459d-af5e-550bbb6a2bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.159178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589f127-7fb6-459d-af5e-550bbb6a2bd6 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.160482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 55/107] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:45.169942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050f963-5788-47b8-a01b-fc5db8d73930 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.170217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050f963-5788-47b8-a01b-fc5db8d73930 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.170495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050f963-5788-47b8-a01b-fc5db8d73930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.197588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0050f963-5788-47b8-a01b-fc5db8d73930 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:45.199204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0050f963-5788-47b8-a01b-fc5db8d73930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:45.208809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:45.312590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 56/108] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:45.313562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050f963-5788-47b8-a01b-fc5db8d73930 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:45.316213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d08d3-08f7-4045-81cb-49529c3c75d1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:45.356377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2a625-ccb9-4e58-b544-2d36a264d0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:45.357371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2a625-ccb9-4e58-b544-2d36a264d0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.357916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2a625-ccb9-4e58-b544-2d36a264d0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.358450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2a625-ccb9-4e58-b544-2d36a264d0a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.370863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2a625-ccb9-4e58-b544-2d36a264d0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-d1e2a625-ccb9-4e58-b544-2d36a264d0a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:45.376223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:45.377074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:12:45.377828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:45.380094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 53/109] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:12:45.385239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2a625-ccb9-4e58-b544-2d36a264d0a2 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:45.434860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050f963-5788-47b8-a01b-fc5db8d73930 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:45.451130 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:45.473003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370f697-c04e-45fd-ab21-125b22daaffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:45.473654 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f697-c04e-45fd-ab21-125b22daaffd None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.473934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f697-c04e-45fd-ab21-125b22daaffd None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.474208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f697-c04e-45fd-ab21-125b22daaffd None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.475331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370f697-c04e-45fd-ab21-125b22daaffd None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:45.477047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370f697-c04e-45fd-ab21-125b22daaffd None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:45.483423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 57/110] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:45 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:45.483423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eede1-9e0a-415c-8cd9-b9370bb4ecd7 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.483423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eede1-9e0a-415c-8cd9-b9370bb4ecd7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.483423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eede1-9e0a-415c-8cd9-b9370bb4ecd7 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.483423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 58/111] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:45.483423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eede1-9e0a-415c-8cd9-b9370bb4ecd7 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:45.495499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:45.501160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2a625-ccb9-4e58-b544-2d36a264d0a2 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:45.536431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae414fe-7f03-404d-84c7-2ccc0ae7ec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:45.537071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae414fe-7f03-404d-84c7-2ccc0ae7ec96 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.537350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae414fe-7f03-404d-84c7-2ccc0ae7ec96 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.537623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae414fe-7f03-404d-84c7-2ccc0ae7ec96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.547753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae414fe-7f03-404d-84c7-2ccc0ae7ec96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-7ae414fe-7f03-404d-84c7-2ccc0ae7ec96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:45.552996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:45.554131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:45.554883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 54/112] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:12:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:45.556041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae3b7f-5d13-4f72-9a2f-8c6b3ba4ca52 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.556041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae3b7f-5d13-4f72-9a2f-8c6b3ba4ca52 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.556041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae3b7f-5d13-4f72-9a2f-8c6b3ba4ca52 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.557092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 55/113] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:45.557756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae3b7f-5d13-4f72-9a2f-8c6b3ba4ca52 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:45.594781 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eede1-9e0a-415c-8cd9-b9370bb4ecd7 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:45.628035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f74627-7558-4eb4-96ce-3a9aa3d43c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:45.628599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f74627-7558-4eb4-96ce-3a9aa3d43c5d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.628876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f74627-7558-4eb4-96ce-3a9aa3d43c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.629146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f74627-7558-4eb4-96ce-3a9aa3d43c5d None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.629839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f74627-7558-4eb4-96ce-3a9aa3d43c5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:45.630140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f74627-7558-4eb4-96ce-3a9aa3d43c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:45.631530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f74627-7558-4eb4-96ce-3a9aa3d43c5d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:45.639383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 59/114] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:12:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:45.640541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c42e-dd39-4628-bdbc-4436c4f277b2 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.640928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c42e-dd39-4628-bdbc-4436c4f277b2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.641206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c42e-dd39-4628-bdbc-4436c4f277b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.658707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-55d2c42e-dd39-4628-bdbc-4436c4f277b2 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:45.660117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-55d2c42e-dd39-4628-bdbc-4436c4f277b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:45.666717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae3b7f-5d13-4f72-9a2f-8c6b3ba4ca52 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:45.683349 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:45.700055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ba3b8-8648-4b35-b974-f938cf01828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:45.700745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba3b8-8648-4b35-b974-f938cf01828e None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.701022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba3b8-8648-4b35-b974-f938cf01828e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.701295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba3b8-8648-4b35-b974-f938cf01828e None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/users/c60ac1ea012749b8837fa25f6f407f9c/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.703171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ba3b8-8648-4b35-b974-f938cf01828e None admin] RBAC: Authorizing `identity:create_grant(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user_id=c60ac1ea012749b8837fa25f6f407f9c, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:45.704654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ba3b8-8648-4b35-b974-f938cf01828e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:45.719871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 56/115] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:12:45 2022] PUT /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/users/c60ac1ea012749b8837fa25f6f407f9c/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:12:45.720692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ba3b8-8648-4b35-b974-f938cf01828e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:45.741173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 60/116] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:45.745969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9e6aa-96f9-40cf-a58d-c93236d9e4d0 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.746572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9e6aa-96f9-40cf-a58d-c93236d9e4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.747084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9e6aa-96f9-40cf-a58d-c93236d9e4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.755028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:45.774908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-99f9e6aa-96f9-40cf-a58d-c93236d9e4d0 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:45.776794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-99f9e6aa-96f9-40cf-a58d-c93236d9e4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:45.852870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ba3b8-8648-4b35-b974-f938cf01828e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:45.877521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 61/117] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:45.879263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9e6aa-96f9-40cf-a58d-c93236d9e4d0 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:45.901606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6682c2-33b5-40da-8d8a-cdd8c136913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:45.902338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6682c2-33b5-40da-8d8a-cdd8c136913e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.902697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6682c2-33b5-40da-8d8a-cdd8c136913e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.902827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6682c2-33b5-40da-8d8a-cdd8c136913e None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.903477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6682c2-33b5-40da-8d8a-cdd8c136913e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:45.903788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6682c2-33b5-40da-8d8a-cdd8c136913e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:45.905597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6682c2-33b5-40da-8d8a-cdd8c136913e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:45.918172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 57/118] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:12:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:45.923217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6682c2-33b5-40da-8d8a-cdd8c136913e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:45.981816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:46.018405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9e6aa-96f9-40cf-a58d-c93236d9e4d0 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.052228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:46.052658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6682c2-33b5-40da-8d8a-cdd8c136913e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.058268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b97a-4788-4c1e-a16b-5a6f37001461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.058925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b97a-4788-4c1e-a16b-5a6f37001461 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.059317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b97a-4788-4c1e-a16b-5a6f37001461 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.059579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b97a-4788-4c1e-a16b-5a6f37001461 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.071908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428b97a-4788-4c1e-a16b-5a6f37001461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-c428b97a-4788-4c1e-a16b-5a6f37001461 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:46.077349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:46.078182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:46.078924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 62/119] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:46.080077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b97a-4788-4c1e-a16b-5a6f37001461 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:46.097307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a3c18-fa3f-492c-8b2b-7a59ff1cfe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.098311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a3c18-fa3f-492c-8b2b-7a59ff1cfe48 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.098797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a3c18-fa3f-492c-8b2b-7a59ff1cfe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.099275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a3c18-fa3f-492c-8b2b-7a59ff1cfe48 None admin] PATH_INFO: `/v3/users/c0fe00f4b3ba4c77be871688b4624fd7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.119106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a3c18-fa3f-492c-8b2b-7a59ff1cfe48 None admin] RBAC: Authorizing `identity:get_user(user_id=c0fe00f4b3ba4c77be871688b4624fd7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:46.121742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a3c18-fa3f-492c-8b2b-7a59ff1cfe48 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:46.123626 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 58/120] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:45 2022] GET /identity/v3/users/c0fe00f4b3ba4c77be871688b4624fd7 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:46.124754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a3c18-fa3f-492c-8b2b-7a59ff1cfe48 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:46.208680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b97a-4788-4c1e-a16b-5a6f37001461 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.237711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:46.242742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a3c18-fa3f-492c-8b2b-7a59ff1cfe48 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.246330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b251f-fdb4-4e22-a4b0-8c4fa4be17fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.246956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b251f-fdb4-4e22-a4b0-8c4fa4be17fd None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.247235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b251f-fdb4-4e22-a4b0-8c4fa4be17fd None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.247511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b251f-fdb4-4e22-a4b0-8c4fa4be17fd None admin] PATH_INFO: `/v3/users/c60ac1ea012749b8837fa25f6f407f9c` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.248703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b251f-fdb4-4e22-a4b0-8c4fa4be17fd None admin] RBAC: Authorizing `identity:get_user(user_id=c60ac1ea012749b8837fa25f6f407f9c)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:46.250173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b251f-fdb4-4e22-a4b0-8c4fa4be17fd None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:46.256440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 63/121] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:46 2022] GET /identity/v3/users/c60ac1ea012749b8837fa25f6f407f9c => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:46.256440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b251f-fdb4-4e22-a4b0-8c4fa4be17fd None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:46.286386 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01582d43-fccd-4d4f-b76f-a5963a8ee5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.287118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01582d43-fccd-4d4f-b76f-a5963a8ee5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.287398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01582d43-fccd-4d4f-b76f-a5963a8ee5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.287673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01582d43-fccd-4d4f-b76f-a5963a8ee5e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.289452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01582d43-fccd-4d4f-b76f-a5963a8ee5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:46.290922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01582d43-fccd-4d4f-b76f-a5963a8ee5e7 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:46.292697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 59/122] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:46.293302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01582d43-fccd-4d4f-b76f-a5963a8ee5e7 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:46.319067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:46.365934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b251f-fdb4-4e22-a4b0-8c4fa4be17fd None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.397715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01582d43-fccd-4d4f-b76f-a5963a8ee5e7 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.406249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344a5c-bc79-461b-9890-35bfd93c1d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.406875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344a5c-bc79-461b-9890-35bfd93c1d47 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.407156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344a5c-bc79-461b-9890-35bfd93c1d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.407431 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344a5c-bc79-461b-9890-35bfd93c1d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.408107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43344a5c-bc79-461b-9890-35bfd93c1d47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:46.408434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43344a5c-bc79-461b-9890-35bfd93c1d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:46.409829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43344a5c-bc79-461b-9890-35bfd93c1d47 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:46.419975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 64/123] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:46.420645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344a5c-bc79-461b-9890-35bfd93c1d47 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:46.440517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7f1df-2bf3-4c22-bde4-97c51d9b6315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.441173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7f1df-2bf3-4c22-bde4-97c51d9b6315 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.441421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7f1df-2bf3-4c22-bde4-97c51d9b6315 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.441697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7f1df-2bf3-4c22-bde4-97c51d9b6315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.478975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:46.515874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7f1df-2bf3-4c22-bde4-97c51d9b6315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:46.517426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7f1df-2bf3-4c22-bde4-97c51d9b6315 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:46.526382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344a5c-bc79-461b-9890-35bfd93c1d47 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.549312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:46.563732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23ad6f-6935-45c8-aeed-5f5afdc08559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.564397 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ad6f-6935-45c8-aeed-5f5afdc08559 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.564684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ad6f-6935-45c8-aeed-5f5afdc08559 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.564956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ad6f-6935-45c8-aeed-5f5afdc08559 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.575904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23ad6f-6935-45c8-aeed-5f5afdc08559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-0f23ad6f-6935-45c8-aeed-5f5afdc08559 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:46.581433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:46.582283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 65/124] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:46.585933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23ad6f-6935-45c8-aeed-5f5afdc08559 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:46.629426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 60/125] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:46.630544 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7f1df-2bf3-4c22-bde4-97c51d9b6315 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:46.695034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23ad6f-6935-45c8-aeed-5f5afdc08559 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.701043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:46.731397 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8adae-adff-4288-8823-3ab63c1cd44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.731925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8adae-adff-4288-8823-3ab63c1cd44a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.732153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8adae-adff-4288-8823-3ab63c1cd44a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.732454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8adae-adff-4288-8823-3ab63c1cd44a None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.733605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8adae-adff-4288-8823-3ab63c1cd44a None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:46.735035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8adae-adff-4288-8823-3ab63c1cd44a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:46.741794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 66/126] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:46 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:46.741794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8adae-adff-4288-8823-3ab63c1cd44a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:46.742003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7f1df-2bf3-4c22-bde4-97c51d9b6315 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.786325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d89b0-45a5-4ef2-807e-7e67512d2593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.786952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d89b0-45a5-4ef2-807e-7e67512d2593 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.787232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d89b0-45a5-4ef2-807e-7e67512d2593 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.787509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d89b0-45a5-4ef2-807e-7e67512d2593 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.788578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d89b0-45a5-4ef2-807e-7e67512d2593 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:46.790062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d89b0-45a5-4ef2-807e-7e67512d2593 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:46.798826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:46.821606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 61/127] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:12:46 2022] POST /identity/v3/projects => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:12:46.822825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d89b0-45a5-4ef2-807e-7e67512d2593 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:46.877152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8adae-adff-4288-8823-3ab63c1cd44a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.926925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a2c98-c18a-4917-9021-e0b7053538f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.927706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a2c98-c18a-4917-9021-e0b7053538f5 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.927998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a2c98-c18a-4917-9021-e0b7053538f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.928303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a2c98-c18a-4917-9021-e0b7053538f5 None admin] PATH_INFO: `/v3/users/0f9ac1f3ebbc4a86af050232d3157e46` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.931227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a2c98-c18a-4917-9021-e0b7053538f5 None admin] RBAC: Authorizing `identity:get_user(user_id=0f9ac1f3ebbc4a86af050232d3157e46)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:46.933215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a2c98-c18a-4917-9021-e0b7053538f5 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:46.935004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 67/128] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:46 2022] GET /identity/v3/users/0f9ac1f3ebbc4a86af050232d3157e46 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:46.935692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a2c98-c18a-4917-9021-e0b7053538f5 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:46.953032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d89b0-45a5-4ef2-807e-7e67512d2593 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.980460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:47.003302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87284a-69c8-4b66-88c3-616f0edcd8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:47.004867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87284a-69c8-4b66-88c3-616f0edcd8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:47.005579 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87284a-69c8-4b66-88c3-616f0edcd8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:47.006036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87284a-69c8-4b66-88c3-616f0edcd8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:47.006973 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87284a-69c8-4b66-88c3-616f0edcd8c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:47.007615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87284a-69c8-4b66-88c3-616f0edcd8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:47.010247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87284a-69c8-4b66-88c3-616f0edcd8c1 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:47.020728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 62/129] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:12:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:47.021771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87284a-69c8-4b66-88c3-616f0edcd8c1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:47.066601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a2c98-c18a-4917-9021-e0b7053538f5 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:47.085700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:47.117718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9f6ee-cc9c-473a-9b08-d39fb5baee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:47.118655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9f6ee-cc9c-473a-9b08-d39fb5baee84 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:47.119006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9f6ee-cc9c-473a-9b08-d39fb5baee84 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:47.119355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9f6ee-cc9c-473a-9b08-d39fb5baee84 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:47.120653 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9f6ee-cc9c-473a-9b08-d39fb5baee84 None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:47.122201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9f6ee-cc9c-473a-9b08-d39fb5baee84 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:47.124422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 68/130] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:46 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:47.125631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9f6ee-cc9c-473a-9b08-d39fb5baee84 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:47.155050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87284a-69c8-4b66-88c3-616f0edcd8c1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:47.201014 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50289c6-95bf-4c96-b6c3-6742346bccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:47.202316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50289c6-95bf-4c96-b6c3-6742346bccaf None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:47.203163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50289c6-95bf-4c96-b6c3-6742346bccaf None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:47.203882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50289c6-95bf-4c96-b6c3-6742346bccaf None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/users/c60ac1ea012749b8837fa25f6f407f9c/roles/e157fabaf96640bf8a975076a70c720d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:47.206392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50289c6-95bf-4c96-b6c3-6742346bccaf None admin] RBAC: Authorizing `identity:create_grant(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user_id=c60ac1ea012749b8837fa25f6f407f9c, role_id=e157fabaf96640bf8a975076a70c720d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:47.208176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50289c6-95bf-4c96-b6c3-6742346bccaf None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:47.237135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 63/131] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:12:47 2022] PUT /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/users/c60ac1ea012749b8837fa25f6f407f9c/roles/e157fabaf96640bf8a975076a70c720d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:12:47.237135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50289c6-95bf-4c96-b6c3-6742346bccaf None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:47.251245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9f6ee-cc9c-473a-9b08-d39fb5baee84 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:47.313988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:47.316979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44adbd0-8828-4473-8b59-99c09a432ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:47.317872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44adbd0-8828-4473-8b59-99c09a432ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:47.318426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44adbd0-8828-4473-8b59-99c09a432ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:47.318885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44adbd0-8828-4473-8b59-99c09a432ac9 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:47.325298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44adbd0-8828-4473-8b59-99c09a432ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:47.327281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44adbd0-8828-4473-8b59-99c09a432ac9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:47.329358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 69/132] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:47 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:47.330383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44adbd0-8828-4473-8b59-99c09a432ac9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:47.384278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50289c6-95bf-4c96-b6c3-6742346bccaf None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:47.410680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:47.458438 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723410-ae72-434b-bc51-f20c7833d5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:47.459477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723410-ae72-434b-bc51-f20c7833d5dc None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:47.460350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723410-ae72-434b-bc51-f20c7833d5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:47.461026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723410-ae72-434b-bc51-f20c7833d5dc None admin] PATH_INFO: `/v3/users/c60ac1ea012749b8837fa25f6f407f9c` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:47.462821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55723410-ae72-434b-bc51-f20c7833d5dc None admin] RBAC: Authorizing `identity:get_user(user_id=c60ac1ea012749b8837fa25f6f407f9c)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:47.465557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55723410-ae72-434b-bc51-f20c7833d5dc None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:47.469814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 64/133] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:47 2022] GET /identity/v3/users/c60ac1ea012749b8837fa25f6f407f9c => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:47.471999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723410-ae72-434b-bc51-f20c7833d5dc None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:47.510631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44adbd0-8828-4473-8b59-99c09a432ac9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:47.554964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa2129-5202-4f58-b040-e64164f5e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:47.555824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2129-5202-4f58-b040-e64164f5e32d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:47.556119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2129-5202-4f58-b040-e64164f5e32d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:47.556412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2129-5202-4f58-b040-e64164f5e32d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:47.557587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa2129-5202-4f58-b040-e64164f5e32d None admin] RBAC: Adding query filter params (role.id=908a16375c894bac957d576ea917ac03, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user.id=c0fe00f4b3ba4c77be871688b4624fd7) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:47.557907 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa2129-5202-4f58-b040-e64164f5e32d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:47.559853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa2129-5202-4f58-b040-e64164f5e32d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:47.570094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 70/134] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:47 2022] GET /identity/v3/role_assignments?user.id=c0fe00f4b3ba4c77be871688b4624fd7&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=908a16375c894bac957d576ea917ac03 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:47.570094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa2129-5202-4f58-b040-e64164f5e32d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:47.625933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723410-ae72-434b-bc51-f20c7833d5dc None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:47.646365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:47.695451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa2129-5202-4f58-b040-e64164f5e32d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:47.716819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:47.718977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb6775-b32d-4f2e-80b5-f134b33a7920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:47.719792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6775-b32d-4f2e-80b5-f134b33a7920 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:47.720144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6775-b32d-4f2e-80b5-f134b33a7920 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:47.720501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6775-b32d-4f2e-80b5-f134b33a7920 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/users/0f9ac1f3ebbc4a86af050232d3157e46/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:47.726276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb6775-b32d-4f2e-80b5-f134b33a7920 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user_id=0f9ac1f3ebbc4a86af050232d3157e46, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:47.727999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb6775-b32d-4f2e-80b5-f134b33a7920 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:47.738061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db0df3-a158-4f81-8248-baf869532be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:47.739023 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db0df3-a158-4f81-8248-baf869532be1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:47.739465 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db0df3-a158-4f81-8248-baf869532be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:47.739932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db0df3-a158-4f81-8248-baf869532be1 None admin] PATH_INFO: `/v3/projects/e1a27c58f1014fef96de0c567dd4f420` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:47.741757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db0df3-a158-4f81-8248-baf869532be1 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a27c58f1014fef96de0c567dd4f420)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:47.743498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db0df3-a158-4f81-8248-baf869532be1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:47.745470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 71/135] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:47 2022] GET /identity/v3/projects/e1a27c58f1014fef96de0c567dd4f420 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:47.752511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db0df3-a158-4f81-8248-baf869532be1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:47.758405 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 65/136] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:12:47 2022] PUT /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/users/0f9ac1f3ebbc4a86af050232d3157e46/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:12:47.875670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db0df3-a158-4f81-8248-baf869532be1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:47.913385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea4df9-b9c4-4541-8950-cf4a84f4cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:47.914215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea4df9-b9c4-4541-8950-cf4a84f4cf8e None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:47.914493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea4df9-b9c4-4541-8950-cf4a84f4cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:47.914769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea4df9-b9c4-4541-8950-cf4a84f4cf8e None admin] PATH_INFO: `/v3/projects/e1a27c58f1014fef96de0c567dd4f420/users/c60ac1ea012749b8837fa25f6f407f9c/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:47.916821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea4df9-b9c4-4541-8950-cf4a84f4cf8e None admin] RBAC: Authorizing `identity:create_grant(project_id=e1a27c58f1014fef96de0c567dd4f420, user_id=c60ac1ea012749b8837fa25f6f407f9c, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:47.918380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea4df9-b9c4-4541-8950-cf4a84f4cf8e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:47.942736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 72/137] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:12:47 2022] PUT /identity/v3/projects/e1a27c58f1014fef96de0c567dd4f420/users/c60ac1ea012749b8837fa25f6f407f9c/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:12:48.579722 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78246460-0cbc-4311-bac7-c90a05af2fac None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:48.580294 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78246460-0cbc-4311-bac7-c90a05af2fac None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:48.580409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78246460-0cbc-4311-bac7-c90a05af2fac None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:48.581783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 66/138] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:48.588411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07089e-90a4-4729-8200-0611f508ad0c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:48.588720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07089e-90a4-4729-8200-0611f508ad0c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:48.588956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07089e-90a4-4729-8200-0611f508ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:48.611313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-af07089e-90a4-4729-8200-0611f508ad0c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:48.612528 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-af07089e-90a4-4729-8200-0611f508ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:48.668605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:48.702717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 73/139] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:49.260846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78246460-0cbc-4311-bac7-c90a05af2fac None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:49.371781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78246460-0cbc-4311-bac7-c90a05af2fac None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:49.409154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95964b2-ad25-4e81-90f6-8901725511f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:49.409805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95964b2-ad25-4e81-90f6-8901725511f6 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:49.410103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95964b2-ad25-4e81-90f6-8901725511f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:49.410366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95964b2-ad25-4e81-90f6-8901725511f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:49.421137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95964b2-ad25-4e81-90f6-8901725511f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-f95964b2-ad25-4e81-90f6-8901725511f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:49.426037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:49.426900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:49.427683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 67/140] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:49.434868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07089e-90a4-4729-8200-0611f508ad0c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:49.551200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07089e-90a4-4729-8200-0611f508ad0c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:49.586833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2877d55-9110-4e4e-aa58-f58cf86a224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:49.587445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2877d55-9110-4e4e-aa58-f58cf86a224e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:49.587722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2877d55-9110-4e4e-aa58-f58cf86a224e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:49.587999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2877d55-9110-4e4e-aa58-f58cf86a224e None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:49.591464 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2877d55-9110-4e4e-aa58-f58cf86a224e None admin] RBAC: Adding query filter params (name=member) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:49.591464 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2877d55-9110-4e4e-aa58-f58cf86a224e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:49.591464 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2877d55-9110-4e4e-aa58-f58cf86a224e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:49.604713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 74/141] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:12:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:49.610270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95964b2-ad25-4e81-90f6-8901725511f6 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:49.660010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:49.747614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95964b2-ad25-4e81-90f6-8901725511f6 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:49.782782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8a163-0685-49f1-9794-16b37458571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:49.783435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8a163-0685-49f1-9794-16b37458571d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:49.783719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8a163-0685-49f1-9794-16b37458571d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:49.784000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8a163-0685-49f1-9794-16b37458571d None admin] PATH_INFO: `/v3/users/c60ac1ea012749b8837fa25f6f407f9c` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:49.785202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8a163-0685-49f1-9794-16b37458571d None admin] RBAC: Authorizing `identity:get_user(user_id=c60ac1ea012749b8837fa25f6f407f9c)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:49.786659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8a163-0685-49f1-9794-16b37458571d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:49.788679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 68/142] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:49 2022] GET /identity/v3/users/c60ac1ea012749b8837fa25f6f407f9c => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:49.794149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2877d55-9110-4e4e-aa58-f58cf86a224e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:49.841277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:49.927265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2877d55-9110-4e4e-aa58-f58cf86a224e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:49.958627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5a245-e822-4b01-91d6-a66f5349a1d8 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:49.958927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5a245-e822-4b01-91d6-a66f5349a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:49.959186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5a245-e822-4b01-91d6-a66f5349a1d8 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:49.960809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 69/143] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:49.966005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def932ec-1c4e-4261-ad41-f0419a2be5cd None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:49.966292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def932ec-1c4e-4261-ad41-f0419a2be5cd None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:49.966569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def932ec-1c4e-4261-ad41-f0419a2be5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:49.993501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-def932ec-1c4e-4261-ad41-f0419a2be5cd None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:49.994717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-def932ec-1c4e-4261-ad41-f0419a2be5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:49.999282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7784f76-6138-4714-8ad9-ffe5d3685649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:49.999910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7784f76-6138-4714-8ad9-ffe5d3685649 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:50.000191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7784f76-6138-4714-8ad9-ffe5d3685649 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:50.000492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7784f76-6138-4714-8ad9-ffe5d3685649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:50.107403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 70/144] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:12:50.141417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7784f76-6138-4714-8ad9-ffe5d3685649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:50.142983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7784f76-6138-4714-8ad9-ffe5d3685649 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:50.197309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:50.272089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 75/145] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:50.277649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def932ec-1c4e-4261-ad41-f0419a2be5cd None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:50.316763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:50.408891 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def932ec-1c4e-4261-ad41-f0419a2be5cd None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:50.443312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74af8a-5f1f-4572-8e33-0e638e0b4eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:50.444052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74af8a-5f1f-4572-8e33-0e638e0b4eaf None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:50.444336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74af8a-5f1f-4572-8e33-0e638e0b4eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:50.444641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74af8a-5f1f-4572-8e33-0e638e0b4eaf None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:50.445781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74af8a-5f1f-4572-8e33-0e638e0b4eaf None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:50.447642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74af8a-5f1f-4572-8e33-0e638e0b4eaf None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:50.449767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 71/146] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:50 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:50.457286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7784f76-6138-4714-8ad9-ffe5d3685649 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:50.504789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784ae77-effb-45c3-be9d-2e152800d632 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:50.505409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784ae77-effb-45c3-be9d-2e152800d632 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:50.505890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784ae77-effb-45c3-be9d-2e152800d632 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:50.507724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 72/147] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:12:50.513913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21004d6d-0f7d-49a5-9af3-ddde7d27ce93 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:50.514440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21004d6d-0f7d-49a5-9af3-ddde7d27ce93 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:50.514932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21004d6d-0f7d-49a5-9af3-ddde7d27ce93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:50.545443 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-21004d6d-0f7d-49a5-9af3-ddde7d27ce93 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:50.549012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-21004d6d-0f7d-49a5-9af3-ddde7d27ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:50.634165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7784f76-6138-4714-8ad9-ffe5d3685649 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:50.680304 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 73/148] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:12:50.683999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21004d6d-0f7d-49a5-9af3-ddde7d27ce93 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:50.724328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111b744-2ec1-4a94-9d6c-ea160e984529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:50.724988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b744-2ec1-4a94-9d6c-ea160e984529 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:50.725337 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b744-2ec1-4a94-9d6c-ea160e984529 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:50.725609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b744-2ec1-4a94-9d6c-ea160e984529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:50.726383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111b744-2ec1-4a94-9d6c-ea160e984529 None admin] RBAC: Adding query filter params (role.id=4debeb1d97ca4a77afef4ab92d134846, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user.id=c60ac1ea012749b8837fa25f6f407f9c) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:50.726751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111b744-2ec1-4a94-9d6c-ea160e984529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:50.728301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111b744-2ec1-4a94-9d6c-ea160e984529 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:50.740194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 76/149] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:50 2022] GET /identity/v3/role_assignments?user.id=c60ac1ea012749b8837fa25f6f407f9c&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:50.749730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:50.871639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21004d6d-0f7d-49a5-9af3-ddde7d27ce93 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:50.920313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473fed1-3fd0-4220-abfa-04afdbbbbad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:50.921003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473fed1-3fd0-4220-abfa-04afdbbbbad3 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:50.921282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473fed1-3fd0-4220-abfa-04afdbbbbad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:50.921556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473fed1-3fd0-4220-abfa-04afdbbbbad3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:50.922692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473fed1-3fd0-4220-abfa-04afdbbbbad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:50.924158 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473fed1-3fd0-4220-abfa-04afdbbbbad3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:50.925804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 74/150] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:50.932141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111b744-2ec1-4a94-9d6c-ea160e984529 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:50.939221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:50.989917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a58a68-5f0c-4c6c-8ba9-6455a797aab5 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:50.990198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a58a68-5f0c-4c6c-8ba9-6455a797aab5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:50.990710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a58a68-5f0c-4c6c-8ba9-6455a797aab5 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:50.993388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 75/151] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:51.005099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3419b-f717-4b0e-97d5-06424de2e2fa None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.005673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3419b-f717-4b0e-97d5-06424de2e2fa None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.005950 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3419b-f717-4b0e-97d5-06424de2e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.039517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-fde3419b-f717-4b0e-97d5-06424de2e2fa None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:51.041556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-fde3419b-f717-4b0e-97d5-06424de2e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:51.115075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111b744-2ec1-4a94-9d6c-ea160e984529 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:51.147233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 76/152] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:51.148510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3419b-f717-4b0e-97d5-06424de2e2fa None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:51.162007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe6c21-b059-49f4-a73e-2c10281d6c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:51.163002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6c21-b059-49f4-a73e-2c10281d6c9b None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.163570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6c21-b059-49f4-a73e-2c10281d6c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.164072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6c21-b059-49f4-a73e-2c10281d6c9b None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.164899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe6c21-b059-49f4-a73e-2c10281d6c9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:51.167346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe6c21-b059-49f4-a73e-2c10281d6c9b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:51.176743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:51.203015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 77/153] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:12:50 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:12:51.264771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d0a0c-d215-497d-9710-b438d16d4f2b None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.265396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d0a0c-d215-497d-9710-b438d16d4f2b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.265862 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d0a0c-d215-497d-9710-b438d16d4f2b None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.267420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 78/154] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:12:51.274687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe13dc2-7971-4463-a736-4d97c0610aa1 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.275098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe13dc2-7971-4463-a736-4d97c0610aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.275578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe13dc2-7971-4463-a736-4d97c0610aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.277078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3419b-f717-4b0e-97d5-06424de2e2fa None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:51.319599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8fe13dc2-7971-4463-a736-4d97c0610aa1 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:51.321367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8fe13dc2-7971-4463-a736-4d97c0610aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:51.334774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750e760-6000-4a47-b83c-ab1aaaafa546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:51.335810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750e760-6000-4a47-b83c-ab1aaaafa546 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.336281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750e760-6000-4a47-b83c-ab1aaaafa546 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.336776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750e760-6000-4a47-b83c-ab1aaaafa546 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.358224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750e760-6000-4a47-b83c-ab1aaaafa546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-7750e760-6000-4a47-b83c-ab1aaaafa546 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:51.366758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:51.367669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:12:51.368457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:51.372135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 77/155] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:12:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:51.379101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750e760-6000-4a47-b83c-ab1aaaafa546 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:51.439373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:51.463836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 79/156] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:51.465859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf9c9c-3095-4947-8be7-762db6dbe317 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.466285 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf9c9c-3095-4947-8be7-762db6dbe317 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.466696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf9c9c-3095-4947-8be7-762db6dbe317 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.468122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 80/157] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:51.473989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729fbf5-ae8c-4e24-8348-e39b18825096 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.474455 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729fbf5-ae8c-4e24-8348-e39b18825096 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.474868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729fbf5-ae8c-4e24-8348-e39b18825096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.499662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f729fbf5-ae8c-4e24-8348-e39b18825096 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:51.501372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f729fbf5-ae8c-4e24-8348-e39b18825096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:51.527187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:51.553172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750e760-6000-4a47-b83c-ab1aaaafa546 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:51.596274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 81/158] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:51.596729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729fbf5-ae8c-4e24-8348-e39b18825096 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:51.598607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e26106-aaa4-43cd-ba4a-c1d629ca4a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:51.599234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e26106-aaa4-43cd-ba4a-c1d629ca4a65 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.599517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e26106-aaa4-43cd-ba4a-c1d629ca4a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.599815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e26106-aaa4-43cd-ba4a-c1d629ca4a65 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.601301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e26106-aaa4-43cd-ba4a-c1d629ca4a65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:51.601605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e26106-aaa4-43cd-ba4a-c1d629ca4a65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:51.603016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e26106-aaa4-43cd-ba4a-c1d629ca4a65 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:51.612144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 78/159] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:12:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:51.618595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e26106-aaa4-43cd-ba4a-c1d629ca4a65 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:51.723072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729fbf5-ae8c-4e24-8348-e39b18825096 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:51.748779 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:51.755117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e26106-aaa4-43cd-ba4a-c1d629ca4a65 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:51.766387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf771d-ff50-460c-8cd9-0b10157adbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:51.767111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf771d-ff50-460c-8cd9-0b10157adbbe None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.767500 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf771d-ff50-460c-8cd9-0b10157adbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.767782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf771d-ff50-460c-8cd9-0b10157adbbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.783976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf771d-ff50-460c-8cd9-0b10157adbbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-11cf771d-ff50-460c-8cd9-0b10157adbbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:51.791901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:51.792882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:51.793682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 82/160] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:51.797451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd2676-6a31-4f9e-8848-a0f1578e35a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:51.798114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd2676-6a31-4f9e-8848-a0f1578e35a7 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.798394 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd2676-6a31-4f9e-8848-a0f1578e35a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.798670 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd2676-6a31-4f9e-8848-a0f1578e35a7 None admin] PATH_INFO: `/v3/users/c60ac1ea012749b8837fa25f6f407f9c` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.799214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf771d-ff50-460c-8cd9-0b10157adbbe None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:51.800491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd2676-6a31-4f9e-8848-a0f1578e35a7 None admin] RBAC: Authorizing `identity:get_user(user_id=c60ac1ea012749b8837fa25f6f407f9c)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:51.801952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd2676-6a31-4f9e-8848-a0f1578e35a7 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:51.803999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 79/161] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:51 2022] GET /identity/v3/users/c60ac1ea012749b8837fa25f6f407f9c => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:51.805051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd2676-6a31-4f9e-8848-a0f1578e35a7 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:51.824770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:51.927906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf771d-ff50-460c-8cd9-0b10157adbbe None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:51.935843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd2676-6a31-4f9e-8848-a0f1578e35a7 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:51.968594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbaf94-e5bf-4737-befa-0c6c8286302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:51.969212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbaf94-e5bf-4737-befa-0c6c8286302c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.969488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbaf94-e5bf-4737-befa-0c6c8286302c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.969758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbaf94-e5bf-4737-befa-0c6c8286302c None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.970428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbaf94-e5bf-4737-befa-0c6c8286302c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:51.970726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbaf94-e5bf-4737-befa-0c6c8286302c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:51.972123 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbaf94-e5bf-4737-befa-0c6c8286302c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:51.976093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55cee7-fd6b-44cb-9d93-70e6c7497cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:51.976679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55cee7-fd6b-44cb-9d93-70e6c7497cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.977196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55cee7-fd6b-44cb-9d93-70e6c7497cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.977733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55cee7-fd6b-44cb-9d93-70e6c7497cf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.985954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 83/162] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:12:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:51.986867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbaf94-e5bf-4737-befa-0c6c8286302c None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:51.994871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55cee7-fd6b-44cb-9d93-70e6c7497cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-0e55cee7-fd6b-44cb-9d93-70e6c7497cf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:52.000953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:52.001864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:52.002645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 80/163] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:12:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:52.003299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55cee7-fd6b-44cb-9d93-70e6c7497cf4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:52.051329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:52.086263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:52.123426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbaf94-e5bf-4737-befa-0c6c8286302c None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:52.124051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55cee7-fd6b-44cb-9d93-70e6c7497cf4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:52.166698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568d6de-327c-42e3-957f-9afbb54410b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:52.167329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568d6de-327c-42e3-957f-9afbb54410b7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:52.167611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568d6de-327c-42e3-957f-9afbb54410b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:52.167888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568d6de-327c-42e3-957f-9afbb54410b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:52.170738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc0c60-5022-403e-86df-2905bf1e9abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:52.172356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc0c60-5022-403e-86df-2905bf1e9abe None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:52.172736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc0c60-5022-403e-86df-2905bf1e9abe None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:52.173073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc0c60-5022-403e-86df-2905bf1e9abe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:52.186979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc0c60-5022-403e-86df-2905bf1e9abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-28bc0c60-5022-403e-86df-2905bf1e9abe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:52.198341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:52.199296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:52.200075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 81/164] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:52.200797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc0c60-5022-403e-86df-2905bf1e9abe None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:52.292588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568d6de-327c-42e3-957f-9afbb54410b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:52.294983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568d6de-327c-42e3-957f-9afbb54410b7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:52.374571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:52.389122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc0c60-5022-403e-86df-2905bf1e9abe None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:52.456583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:52.461444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fbe59-767c-48d4-aa4d-3cf6dfeb6409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:52.464708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fbe59-767c-48d4-aa4d-3cf6dfeb6409 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:52.465298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fbe59-767c-48d4-aa4d-3cf6dfeb6409 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:52.465814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fbe59-767c-48d4-aa4d-3cf6dfeb6409 None admin] PATH_INFO: `/v3/users/c0fe00f4b3ba4c77be871688b4624fd7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:52.467483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fbe59-767c-48d4-aa4d-3cf6dfeb6409 None admin] RBAC: Authorizing `identity:get_user(user_id=c0fe00f4b3ba4c77be871688b4624fd7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:52.469429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fbe59-767c-48d4-aa4d-3cf6dfeb6409 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:52.471387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 82/165] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:52 2022] GET /identity/v3/users/c0fe00f4b3ba4c77be871688b4624fd7 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:52.472528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fbe59-767c-48d4-aa4d-3cf6dfeb6409 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:52.481174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 84/166] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:52.482133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568d6de-327c-42e3-957f-9afbb54410b7 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:52.594415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568d6de-327c-42e3-957f-9afbb54410b7 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:52.630427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e7918-bfe7-40c9-a103-7c9826840fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:52.631220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e7918-bfe7-40c9-a103-7c9826840fcd None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:52.631647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e7918-bfe7-40c9-a103-7c9826840fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:52.632183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e7918-bfe7-40c9-a103-7c9826840fcd None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:52.632801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e7918-bfe7-40c9-a103-7c9826840fcd None admin] RBAC: Adding query filter params (name=member) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:52.633205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e7918-bfe7-40c9-a103-7c9826840fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:52.634696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e7918-bfe7-40c9-a103-7c9826840fcd None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:52.643539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 85/167] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:12:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:52.644703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e7918-bfe7-40c9-a103-7c9826840fcd None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:52.664797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:52.677587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fbe59-767c-48d4-aa4d-3cf6dfeb6409 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:52.763419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a40a45-3469-4a79-9583-8a9546874f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:52.764045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a40a45-3469-4a79-9583-8a9546874f0c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:52.764299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a40a45-3469-4a79-9583-8a9546874f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:52.764516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a40a45-3469-4a79-9583-8a9546874f0c None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:52.765441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a40a45-3469-4a79-9583-8a9546874f0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:52.765540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a40a45-3469-4a79-9583-8a9546874f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:52.768676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a40a45-3469-4a79-9583-8a9546874f0c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:52.779894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e7918-bfe7-40c9-a103-7c9826840fcd None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:52.791888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 83/168] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:52.792794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a40a45-3469-4a79-9583-8a9546874f0c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:52.815567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe4400-64aa-4855-a708-0e1030f491ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:52.816216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe4400-64aa-4855-a708-0e1030f491ef None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:52.816548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe4400-64aa-4855-a708-0e1030f491ef None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:52.816826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe4400-64aa-4855-a708-0e1030f491ef None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:52.817969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe4400-64aa-4855-a708-0e1030f491ef None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:52.819808 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe4400-64aa-4855-a708-0e1030f491ef None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:52.822172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 86/169] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:52 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:52.822958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe4400-64aa-4855-a708-0e1030f491ef None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:52.916856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:52.918605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:52.926611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe4400-64aa-4855-a708-0e1030f491ef None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:52.962614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e5add-31e3-4295-b812-3d5f42ff93e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:52.963283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e5add-31e3-4295-b812-3d5f42ff93e7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:52.963569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e5add-31e3-4295-b812-3d5f42ff93e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:52.963845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e5add-31e3-4295-b812-3d5f42ff93e7 None admin] PATH_INFO: `/v3/users/c60ac1ea012749b8837fa25f6f407f9c` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:52.965103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e5add-31e3-4295-b812-3d5f42ff93e7 None admin] RBAC: Authorizing `identity:get_user(user_id=c60ac1ea012749b8837fa25f6f407f9c)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:52.967117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e5add-31e3-4295-b812-3d5f42ff93e7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:52.969212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 87/170] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:52 2022] GET /identity/v3/users/c60ac1ea012749b8837fa25f6f407f9c => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:52.970061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e5add-31e3-4295-b812-3d5f42ff93e7 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:53.010392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a40a45-3469-4a79-9583-8a9546874f0c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:53.075781 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e5add-31e3-4295-b812-3d5f42ff93e7 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:53.090240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca9c51-aa29-469d-a815-c929b63db898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:53.090909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca9c51-aa29-469d-a815-c929b63db898 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:53.091244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca9c51-aa29-469d-a815-c929b63db898 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:53.091525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca9c51-aa29-469d-a815-c929b63db898 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:53.096400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca9c51-aa29-469d-a815-c929b63db898 None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:53.098096 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca9c51-aa29-469d-a815-c929b63db898 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:53.100007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 84/171] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:52 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:53.101073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca9c51-aa29-469d-a815-c929b63db898 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:53.115089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242085-208f-4099-b9fe-8cb88c5bce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:53.115962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242085-208f-4099-b9fe-8cb88c5bce89 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:53.116257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242085-208f-4099-b9fe-8cb88c5bce89 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:53.116476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242085-208f-4099-b9fe-8cb88c5bce89 None admin] PATH_INFO: `/v3/users/0f9ac1f3ebbc4a86af050232d3157e46` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:53.117724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4242085-208f-4099-b9fe-8cb88c5bce89 None admin] RBAC: Authorizing `identity:get_user(user_id=0f9ac1f3ebbc4a86af050232d3157e46)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:53.119249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4242085-208f-4099-b9fe-8cb88c5bce89 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:53.120990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 88/172] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:52 2022] GET /identity/v3/users/0f9ac1f3ebbc4a86af050232d3157e46 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:53.121902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242085-208f-4099-b9fe-8cb88c5bce89 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:53.131398 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:53.228789 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242085-208f-4099-b9fe-8cb88c5bce89 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:53.263944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38423aec-aba4-4299-93c8-b891f3524930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:53.264861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38423aec-aba4-4299-93c8-b891f3524930 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:53.265308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38423aec-aba4-4299-93c8-b891f3524930 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:53.265725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38423aec-aba4-4299-93c8-b891f3524930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:53.336331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38423aec-aba4-4299-93c8-b891f3524930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:53.338065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38423aec-aba4-4299-93c8-b891f3524930 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:53.346606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:53.374789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca9c51-aa29-469d-a815-c929b63db898 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:53.444785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 89/173] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:53.445930 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38423aec-aba4-4299-93c8-b891f3524930 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:53.448727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:53.469142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ed44c-8172-408a-bc08-c306184c0ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:53.469943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ed44c-8172-408a-bc08-c306184c0ff8 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:53.470298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ed44c-8172-408a-bc08-c306184c0ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:53.470917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ed44c-8172-408a-bc08-c306184c0ff8 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/users/c0fe00f4b3ba4c77be871688b4624fd7/roles/908a16375c894bac957d576ea917ac03` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:53.477243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ed44c-8172-408a-bc08-c306184c0ff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user_id=c0fe00f4b3ba4c77be871688b4624fd7, role_id=908a16375c894bac957d576ea917ac03)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:53.478718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ed44c-8172-408a-bc08-c306184c0ff8 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:53.514710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 85/174] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:12:53 2022] PUT /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/users/c0fe00f4b3ba4c77be871688b4624fd7/roles/908a16375c894bac957d576ea917ac03 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:12:53.515737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ed44c-8172-408a-bc08-c306184c0ff8 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:53.558240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38423aec-aba4-4299-93c8-b891f3524930 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:53.567446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:53.598603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8107b5-94a7-4349-ad3b-15a745e4c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:53.599629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8107b5-94a7-4349-ad3b-15a745e4c466 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:53.600210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8107b5-94a7-4349-ad3b-15a745e4c466 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:53.600712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8107b5-94a7-4349-ad3b-15a745e4c466 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:53.601655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8107b5-94a7-4349-ad3b-15a745e4c466 None admin] RBAC: Adding query filter params (role.id=e157fabaf96640bf8a975076a70c720d, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user.id=c60ac1ea012749b8837fa25f6f407f9c) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:53.602163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8107b5-94a7-4349-ad3b-15a745e4c466 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:53.604021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8107b5-94a7-4349-ad3b-15a745e4c466 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:53.610769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 90/175] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:53 2022] GET /identity/v3/role_assignments?user.id=c60ac1ea012749b8837fa25f6f407f9c&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=e157fabaf96640bf8a975076a70c720d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:53.611834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8107b5-94a7-4349-ad3b-15a745e4c466 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:53.744329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ed44c-8172-408a-bc08-c306184c0ff8 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:53.813383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8107b5-94a7-4349-ad3b-15a745e4c466 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:53.819213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e3c9b-b97c-4b6e-a866-89a56de8b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:53.820236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e3c9b-b97c-4b6e-a866-89a56de8b57c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:53.820236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e3c9b-b97c-4b6e-a866-89a56de8b57c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:53.828342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e3c9b-b97c-4b6e-a866-89a56de8b57c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:53.881610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8fb82-ff63-4392-803a-cd41f2000536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:53.882387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fb82-ff63-4392-803a-cd41f2000536 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:53.882607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fb82-ff63-4392-803a-cd41f2000536 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:53.882793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fb82-ff63-4392-803a-cd41f2000536 None admin] PATH_INFO: `/v3/projects/e1a27c58f1014fef96de0c567dd4f420` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:53.883960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8fb82-ff63-4392-803a-cd41f2000536 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a27c58f1014fef96de0c567dd4f420)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:53.885792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8fb82-ff63-4392-803a-cd41f2000536 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:53.887521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 91/176] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:53 2022] GET /identity/v3/projects/e1a27c58f1014fef96de0c567dd4f420 => generated 312 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:53.893767 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8fb82-ff63-4392-803a-cd41f2000536 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:53.955646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:53.972793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:53.981928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e3c9b-b97c-4b6e-a866-89a56de8b57c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:53.983442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e3c9b-b97c-4b6e-a866-89a56de8b57c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:54.099558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8fb82-ff63-4392-803a-cd41f2000536 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:54.168310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500ac30-5f7d-436f-8040-d893251478eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:54.169351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500ac30-5f7d-436f-8040-d893251478eb None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:54.169830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500ac30-5f7d-436f-8040-d893251478eb None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:54.170315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500ac30-5f7d-436f-8040-d893251478eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:54.171268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500ac30-5f7d-436f-8040-d893251478eb None admin] RBAC: Adding query filter params (role.id=4debeb1d97ca4a77afef4ab92d134846, scope.project.id=e1a27c58f1014fef96de0c567dd4f420, user.id=c60ac1ea012749b8837fa25f6f407f9c) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:54.171771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500ac30-5f7d-436f-8040-d893251478eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:54.173467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500ac30-5f7d-436f-8040-d893251478eb None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:54.183337 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 92/177] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:53 2022] GET /identity/v3/role_assignments?user.id=c60ac1ea012749b8837fa25f6f407f9c&scope.project.id=e1a27c58f1014fef96de0c567dd4f420&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:54.195123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 86/178] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:54.201533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500ac30-5f7d-436f-8040-d893251478eb None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:54.341366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500ac30-5f7d-436f-8040-d893251478eb None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:54.343443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:54.397461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676de2d1-5f31-4d7a-b7a7-0c3be92b2d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:54.398136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676de2d1-5f31-4d7a-b7a7-0c3be92b2d23 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:54.398420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676de2d1-5f31-4d7a-b7a7-0c3be92b2d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:54.398765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676de2d1-5f31-4d7a-b7a7-0c3be92b2d23 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:54.400371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676de2d1-5f31-4d7a-b7a7-0c3be92b2d23 None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:54.401939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676de2d1-5f31-4d7a-b7a7-0c3be92b2d23 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:54.403739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 93/179] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:54 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:54.409907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e3c9b-b97c-4b6e-a866-89a56de8b57c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:54.487929 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae11e-87b7-472a-a236-09895c371627 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:54.488616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae11e-87b7-472a-a236-09895c371627 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:54.489090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae11e-87b7-472a-a236-09895c371627 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:54.490766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 94/180] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:12:54.502163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32c137-5b6d-4ab6-b980-822d90761c62 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:54.502910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32c137-5b6d-4ab6-b980-822d90761c62 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:54.503393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32c137-5b6d-4ab6-b980-822d90761c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:54.546976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6b32c137-5b6d-4ab6-b980-822d90761c62 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:54.548307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:54.549603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6b32c137-5b6d-4ab6-b980-822d90761c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:54.567321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e3c9b-b97c-4b6e-a866-89a56de8b57c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:54.641006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2e65e-8221-47c6-a59d-0baec2ebd12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:54.641972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e65e-8221-47c6-a59d-0baec2ebd12d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:54.642393 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e65e-8221-47c6-a59d-0baec2ebd12d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:54.642834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e65e-8221-47c6-a59d-0baec2ebd12d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:54.643750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2e65e-8221-47c6-a59d-0baec2ebd12d None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user.id=0f9ac1f3ebbc4a86af050232d3157e46) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:54.644215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2e65e-8221-47c6-a59d-0baec2ebd12d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:54.646327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2e65e-8221-47c6-a59d-0baec2ebd12d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:54.653598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 87/181] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:54 2022] GET /identity/v3/role_assignments?user.id=0f9ac1f3ebbc4a86af050232d3157e46&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=71bed99a52684ba990097719b40ef99d => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:54.683733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 95/182] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 16 19:12:54.775632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ef6f1-47c3-4442-996a-b3249cbb3d47 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:54.776214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ef6f1-47c3-4442-996a-b3249cbb3d47 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:54.776690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ef6f1-47c3-4442-996a-b3249cbb3d47 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:54.778572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 88/183] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:54.785217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5674695-e105-4bf1-9183-918d5c686225 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:54.785875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5674695-e105-4bf1-9183-918d5c686225 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:54.786351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5674695-e105-4bf1-9183-918d5c686225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:54.808133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-a5674695-e105-4bf1-9183-918d5c686225 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:54.809950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a5674695-e105-4bf1-9183-918d5c686225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:54.891921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 96/184] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:54.932987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f90eab-66a8-476b-a43d-75786b8a2fe6 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:54.933964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f90eab-66a8-476b-a43d-75786b8a2fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:54.934452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f90eab-66a8-476b-a43d-75786b8a2fe6 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:54.936081 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 89/185] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:54.941872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40db25-465c-4a90-8cf6-9f56f3af351c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:54.942407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40db25-465c-4a90-8cf6-9f56f3af351c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:54.942876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40db25-465c-4a90-8cf6-9f56f3af351c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:54.966107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4f40db25-465c-4a90-8cf6-9f56f3af351c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:54.966347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f90eab-66a8-476b-a43d-75786b8a2fe6 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:54.967776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4f40db25-465c-4a90-8cf6-9f56f3af351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:55.009732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:55.072881 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 97/186] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:55.125587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f90eab-66a8-476b-a43d-75786b8a2fe6 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:55.174356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ab618-640f-43f2-8213-63511bb1e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:55.175009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ab618-640f-43f2-8213-63511bb1e852 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:55.175283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ab618-640f-43f2-8213-63511bb1e852 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:55.175550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ab618-640f-43f2-8213-63511bb1e852 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:55.187995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ab618-640f-43f2-8213-63511bb1e852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-da1ab618-640f-43f2-8213-63511bb1e852 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:55.193397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:55.194494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:55.195285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:55.195985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 90/187] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:55.201299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40db25-465c-4a90-8cf6-9f56f3af351c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:55.222737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ab618-640f-43f2-8213-63511bb1e852 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:55.244363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:55.317734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40db25-465c-4a90-8cf6-9f56f3af351c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:55.354090 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ab618-640f-43f2-8213-63511bb1e852 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:55.359086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e97dd-9a2e-4e51-8c8c-023446753628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:55.359953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e97dd-9a2e-4e51-8c8c-023446753628 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:55.360444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e97dd-9a2e-4e51-8c8c-023446753628 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:55.360931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e97dd-9a2e-4e51-8c8c-023446753628 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:55.361904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e97dd-9a2e-4e51-8c8c-023446753628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:55.362400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e97dd-9a2e-4e51-8c8c-023446753628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:55.364064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e97dd-9a2e-4e51-8c8c-023446753628 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:55.373560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 98/188] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:55.379473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e97dd-9a2e-4e51-8c8c-023446753628 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:55.392793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d836-ff39-4d83-9848-05991d00a9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:55.393822 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d836-ff39-4d83-9848-05991d00a9fb None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:55.394104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d836-ff39-4d83-9848-05991d00a9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:55.394373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d836-ff39-4d83-9848-05991d00a9fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:55.406100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105d836-ff39-4d83-9848-05991d00a9fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:55.406642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-3105d836-ff39-4d83-9848-05991d00a9fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:55.411379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:55.412236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:12:55.413205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 91/189] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:12:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:55.418932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d836-ff39-4d83-9848-05991d00a9fb None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:55.491243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e97dd-9a2e-4e51-8c8c-023446753628 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:55.495226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:55.523650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d836-ff39-4d83-9848-05991d00a9fb None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:55.527651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f81dd4-ca00-40d7-9d6d-307e08f80664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:55.528293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f81dd4-ca00-40d7-9d6d-307e08f80664 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:55.528604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f81dd4-ca00-40d7-9d6d-307e08f80664 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:55.528871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f81dd4-ca00-40d7-9d6d-307e08f80664 None admin] PATH_INFO: `/v3/users/8be8918291d348c3b4b7d4b9981fda08` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:55.544809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f81dd4-ca00-40d7-9d6d-307e08f80664 None admin] RBAC: Authorizing `identity:get_user(user_id=8be8918291d348c3b4b7d4b9981fda08)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:55.546963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f81dd4-ca00-40d7-9d6d-307e08f80664 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:55.549392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 99/190] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:55 2022] GET /identity/v3/users/8be8918291d348c3b4b7d4b9981fda08 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:55.550059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f81dd4-ca00-40d7-9d6d-307e08f80664 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:55.567364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efd82e-602e-485f-874c-20ec1c528668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:55.568317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efd82e-602e-485f-874c-20ec1c528668 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:55.569079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efd82e-602e-485f-874c-20ec1c528668 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:55.569897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efd82e-602e-485f-874c-20ec1c528668 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:55.571158 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efd82e-602e-485f-874c-20ec1c528668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:55.573144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efd82e-602e-485f-874c-20ec1c528668 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:55.574879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 92/191] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:55.575766 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efd82e-602e-485f-874c-20ec1c528668 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:55.640968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:55.662816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f81dd4-ca00-40d7-9d6d-307e08f80664 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:55.690717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efd82e-602e-485f-874c-20ec1c528668 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:55.697323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77114e-aa06-44ca-b14c-af75ea15a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:55.697945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77114e-aa06-44ca-b14c-af75ea15a235 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:55.698223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77114e-aa06-44ca-b14c-af75ea15a235 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:55.698489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77114e-aa06-44ca-b14c-af75ea15a235 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:55.699349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77114e-aa06-44ca-b14c-af75ea15a235 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:55.699656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77114e-aa06-44ca-b14c-af75ea15a235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:55.701069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77114e-aa06-44ca-b14c-af75ea15a235 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:55.709934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 100/192] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:12:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:55.710700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77114e-aa06-44ca-b14c-af75ea15a235 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:55.731769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a34e5-6f9c-4d34-9d70-3594577912f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:55.732408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a34e5-6f9c-4d34-9d70-3594577912f4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:55.732757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a34e5-6f9c-4d34-9d70-3594577912f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:55.733038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a34e5-6f9c-4d34-9d70-3594577912f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:55.747309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:55.807789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a34e5-6f9c-4d34-9d70-3594577912f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:55.809501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a34e5-6f9c-4d34-9d70-3594577912f4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:55.824699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77114e-aa06-44ca-b14c-af75ea15a235 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:55.858269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e09660-b7cf-4163-a490-f7ada7ec3cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:55.858893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e09660-b7cf-4163-a490-f7ada7ec3cf2 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:55.859170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e09660-b7cf-4163-a490-f7ada7ec3cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:55.859447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e09660-b7cf-4163-a490-f7ada7ec3cf2 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:55.860101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e09660-b7cf-4163-a490-f7ada7ec3cf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:55.861588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e09660-b7cf-4163-a490-f7ada7ec3cf2 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:55.880536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:55.888519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 101/193] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:12:55 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:12:55.889823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e09660-b7cf-4163-a490-f7ada7ec3cf2 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:55.933294 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 93/194] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:55.939042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a34e5-6f9c-4d34-9d70-3594577912f4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:55.989038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:56.014261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e09660-b7cf-4163-a490-f7ada7ec3cf2 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:56.052237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a468d50-d5fd-4f7b-8ac1-377e16d337bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:56.053286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a468d50-d5fd-4f7b-8ac1-377e16d337bd None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:56.053711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a468d50-d5fd-4f7b-8ac1-377e16d337bd None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:56.053986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a34e5-6f9c-4d34-9d70-3594577912f4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:56.054312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a468d50-d5fd-4f7b-8ac1-377e16d337bd None admin] PATH_INFO: `/v3/users/8be8918291d348c3b4b7d4b9981fda08` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:56.055746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a468d50-d5fd-4f7b-8ac1-377e16d337bd None admin] RBAC: Authorizing `identity:get_user(user_id=8be8918291d348c3b4b7d4b9981fda08)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:56.057426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a468d50-d5fd-4f7b-8ac1-377e16d337bd None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:56.059734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 102/195] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:55 2022] GET /identity/v3/users/8be8918291d348c3b4b7d4b9981fda08 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:56.065760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a468d50-d5fd-4f7b-8ac1-377e16d337bd None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:56.096669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25c680-cc55-47be-acb7-da72226a9256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:56.097574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25c680-cc55-47be-acb7-da72226a9256 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:56.097996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25c680-cc55-47be-acb7-da72226a9256 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:56.098409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25c680-cc55-47be-acb7-da72226a9256 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:56.099693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25c680-cc55-47be-acb7-da72226a9256 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:56.102238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25c680-cc55-47be-acb7-da72226a9256 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:56.104075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 94/196] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:55 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:12:56.110573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25c680-cc55-47be-acb7-da72226a9256 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:56.143981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:56.183180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a468d50-d5fd-4f7b-8ac1-377e16d337bd None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:56.232845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623e05a-1db9-475c-9aeb-91ed4aba172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:56.233714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623e05a-1db9-475c-9aeb-91ed4aba172c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:56.234136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623e05a-1db9-475c-9aeb-91ed4aba172c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:56.234590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623e05a-1db9-475c-9aeb-91ed4aba172c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:56.246362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25c680-cc55-47be-acb7-da72226a9256 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:56.259207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:56.289501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5abe06-bcd0-4eb1-838e-e494d158dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:56.290353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5abe06-bcd0-4eb1-838e-e494d158dec6 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:56.290858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5abe06-bcd0-4eb1-838e-e494d158dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:56.291290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5abe06-bcd0-4eb1-838e-e494d158dec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:56.292636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5abe06-bcd0-4eb1-838e-e494d158dec6 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=07bd28977c0c409484da39a0d92ca5cf, user.id=8be8918291d348c3b4b7d4b9981fda08) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:56.293006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5abe06-bcd0-4eb1-838e-e494d158dec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:56.294846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5abe06-bcd0-4eb1-838e-e494d158dec6 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:56.303944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 95/197] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:56 2022] GET /identity/v3/role_assignments?user.id=8be8918291d348c3b4b7d4b9981fda08&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=71bed99a52684ba990097719b40ef99d => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:56.329725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623e05a-1db9-475c-9aeb-91ed4aba172c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:56.331297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623e05a-1db9-475c-9aeb-91ed4aba172c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:56.410882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:56.456757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 103/198] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:12:56.463227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5abe06-bcd0-4eb1-838e-e494d158dec6 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:56.574977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4904e60-61cd-4a5a-8b84-6855a705fe66 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:56.575225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4904e60-61cd-4a5a-8b84-6855a705fe66 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:56.575554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4904e60-61cd-4a5a-8b84-6855a705fe66 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:56.576869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 104/199] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:12:56.584752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e5f6e-1fa0-47ce-9b65-73d28a0f14c1 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:56.585104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e5f6e-1fa0-47ce-9b65-73d28a0f14c1 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:56.585329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e5f6e-1fa0-47ce-9b65-73d28a0f14c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:56.613658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-207e5f6e-1fa0-47ce-9b65-73d28a0f14c1 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:56.614861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-207e5f6e-1fa0-47ce-9b65-73d28a0f14c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:56.622639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5abe06-bcd0-4eb1-838e-e494d158dec6 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:56.682695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ce8ac-65e1-4575-9fbe-855d8537d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:56.683348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ce8ac-65e1-4575-9fbe-855d8537d897 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:56.683629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ce8ac-65e1-4575-9fbe-855d8537d897 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:56.683907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ce8ac-65e1-4575-9fbe-855d8537d897 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:56.685192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ce8ac-65e1-4575-9fbe-855d8537d897 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:56.686920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ce8ac-65e1-4575-9fbe-855d8537d897 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:56.689161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 96/200] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:56 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:56.698685 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ce8ac-65e1-4575-9fbe-855d8537d897 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:56.711442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 105/201] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:12:56.752767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:56.835803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ce8ac-65e1-4575-9fbe-855d8537d897 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:56.875349 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c1bd2-c5c4-4b43-8b1f-0c79eedfbf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:56.876367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c1bd2-c5c4-4b43-8b1f-0c79eedfbf90 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:56.876868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c1bd2-c5c4-4b43-8b1f-0c79eedfbf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:56.877335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c1bd2-c5c4-4b43-8b1f-0c79eedfbf90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:56.878262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c1bd2-c5c4-4b43-8b1f-0c79eedfbf90 None admin] RBAC: Adding query filter params (role.id=e157fabaf96640bf8a975076a70c720d, scope.project.id=07bd28977c0c409484da39a0d92ca5cf, user.id=8be8918291d348c3b4b7d4b9981fda08) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:56.878864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c1bd2-c5c4-4b43-8b1f-0c79eedfbf90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:56.885784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c1bd2-c5c4-4b43-8b1f-0c79eedfbf90 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:56.892724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 97/202] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:56 2022] GET /identity/v3/role_assignments?user.id=8be8918291d348c3b4b7d4b9981fda08&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=e157fabaf96640bf8a975076a70c720d => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:57.136316 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e5f6e-1fa0-47ce-9b65-73d28a0f14c1 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:57.258138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:57.265497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e5f6e-1fa0-47ce-9b65-73d28a0f14c1 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:57.318060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc06dc-d1e5-4182-a1ce-19f8ca841166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:57.319129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc06dc-d1e5-4182-a1ce-19f8ca841166 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:57.319413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc06dc-d1e5-4182-a1ce-19f8ca841166 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:57.319687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc06dc-d1e5-4182-a1ce-19f8ca841166 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:57.340849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc06dc-d1e5-4182-a1ce-19f8ca841166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-5bfc06dc-d1e5-4182-a1ce-19f8ca841166 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:57.362127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:57.363065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:57.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 106/203] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:12:57.396636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c1bd2-c5c4-4b43-8b1f-0c79eedfbf90 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:57.588951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c1bd2-c5c4-4b43-8b1f-0c79eedfbf90 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:57.604985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:57.654057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725141d8-2990-4ffa-a803-a68ebf5c127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:57.654604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725141d8-2990-4ffa-a803-a68ebf5c127b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:57.654883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725141d8-2990-4ffa-a803-a68ebf5c127b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:57.655155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725141d8-2990-4ffa-a803-a68ebf5c127b None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:57.655834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725141d8-2990-4ffa-a803-a68ebf5c127b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:57.656136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725141d8-2990-4ffa-a803-a68ebf5c127b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:57.657618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725141d8-2990-4ffa-a803-a68ebf5c127b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:57.675304 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 98/204] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:12:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:57.685518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc06dc-d1e5-4182-a1ce-19f8ca841166 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:57.900471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc06dc-d1e5-4182-a1ce-19f8ca841166 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:57.982602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c85b3e-0d72-41c0-80cf-cfc63a884395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:57.983354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85b3e-0d72-41c0-80cf-cfc63a884395 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:57.983725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85b3e-0d72-41c0-80cf-cfc63a884395 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:57.984096 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85b3e-0d72-41c0-80cf-cfc63a884395 None admin] PATH_INFO: `/v3/users/c0fe00f4b3ba4c77be871688b4624fd7` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:57.989076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c85b3e-0d72-41c0-80cf-cfc63a884395 None admin] RBAC: Authorizing `identity:get_user(user_id=c0fe00f4b3ba4c77be871688b4624fd7)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:57.990736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c85b3e-0d72-41c0-80cf-cfc63a884395 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:57.992670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 107/205] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:57 2022] GET /identity/v3/users/c0fe00f4b3ba4c77be871688b4624fd7 => generated 289 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:57.998340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725141d8-2990-4ffa-a803-a68ebf5c127b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:58.152969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725141d8-2990-4ffa-a803-a68ebf5c127b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:58.195106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeed24-1ed8-4b13-b3f9-41d4b972317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:58.195965 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeed24-1ed8-4b13-b3f9-41d4b972317a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:58.196408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeed24-1ed8-4b13-b3f9-41d4b972317a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:58.197144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeed24-1ed8-4b13-b3f9-41d4b972317a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:58.257951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:58.281268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeed24-1ed8-4b13-b3f9-41d4b972317a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:58.282951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeed24-1ed8-4b13-b3f9-41d4b972317a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:58.392123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 99/206] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:12:58.398242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c85b3e-0d72-41c0-80cf-cfc63a884395 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:58.441385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:58.542067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c85b3e-0d72-41c0-80cf-cfc63a884395 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:58.586763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb6202-ea1a-48d6-9817-e98feb0f98a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:58.587453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6202-ea1a-48d6-9817-e98feb0f98a9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:58.587733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6202-ea1a-48d6-9817-e98feb0f98a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:58.588008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6202-ea1a-48d6-9817-e98feb0f98a9 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:58.589330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb6202-ea1a-48d6-9817-e98feb0f98a9 None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:58.590920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb6202-ea1a-48d6-9817-e98feb0f98a9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:58.592776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 108/207] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:12:58 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:58.598995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeed24-1ed8-4b13-b3f9-41d4b972317a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:58.691910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:58.712297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da609a3-b9d4-4e73-a97d-7974e9a6962e None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:58.712978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da609a3-b9d4-4e73-a97d-7974e9a6962e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:58.713450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da609a3-b9d4-4e73-a97d-7974e9a6962e None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:58.716369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 109/208] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:12:58.720688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679967cc-b258-4097-9d4d-9d6ee8f6ec6c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:58.721185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679967cc-b258-4097-9d4d-9d6ee8f6ec6c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:58.721673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679967cc-b258-4097-9d4d-9d6ee8f6ec6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:58.748152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeed24-1ed8-4b13-b3f9-41d4b972317a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:58.761514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-679967cc-b258-4097-9d4d-9d6ee8f6ec6c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:58.763135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-679967cc-b258-4097-9d4d-9d6ee8f6ec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:58.813291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788caaa-24fc-4c81-8978-7c4f7414c19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:58.814263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788caaa-24fc-4c81-8978-7c4f7414c19a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:58.814739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788caaa-24fc-4c81-8978-7c4f7414c19a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:58.815205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788caaa-24fc-4c81-8978-7c4f7414c19a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:58.816182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788caaa-24fc-4c81-8978-7c4f7414c19a None admin] RBAC: Adding query filter params (role.id=908a16375c894bac957d576ea917ac03, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea, user.id=c0fe00f4b3ba4c77be871688b4624fd7) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:58.816721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788caaa-24fc-4c81-8978-7c4f7414c19a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:58.818627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788caaa-24fc-4c81-8978-7c4f7414c19a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:58.825606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 100/209] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:12:58 2022] GET /identity/v3/role_assignments?user.id=c0fe00f4b3ba4c77be871688b4624fd7&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=908a16375c894bac957d576ea917ac03 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:58.872549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 110/210] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:12:59.063088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d84a-940f-49ea-a2e3-edc0a2c7b4d9 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.063536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d84a-940f-49ea-a2e3-edc0a2c7b4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.063645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d84a-940f-49ea-a2e3-edc0a2c7b4d9 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.065091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 101/211] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:59.082276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4750c-f744-4abc-be3d-eff286cbe96a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.083274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4750c-f744-4abc-be3d-eff286cbe96a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.083759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4750c-f744-4abc-be3d-eff286cbe96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.106003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5eb4750c-f744-4abc-be3d-eff286cbe96a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:59.107509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5eb4750c-f744-4abc-be3d-eff286cbe96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:59.133032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:59.160226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909521d-f2d5-4710-8e25-8f726c20736c None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.160226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909521d-f2d5-4710-8e25-8f726c20736c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.160226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909521d-f2d5-4710-8e25-8f726c20736c None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.161939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 102/212] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:59.167204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4bd00-1f4d-485c-b2a9-bedb81093a09 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.167747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4bd00-1f4d-485c-b2a9-bedb81093a09 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.168592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4bd00-1f4d-485c-b2a9-bedb81093a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.195519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-eff4bd00-1f4d-485c-b2a9-bedb81093a09 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:59.197134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-eff4bd00-1f4d-485c-b2a9-bedb81093a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:59.203244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 111/213] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:12:59.245279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4750c-f744-4abc-be3d-eff286cbe96a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:59.276708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 103/214] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:12:59.362460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4750c-f744-4abc-be3d-eff286cbe96a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:59.401873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a704c9-80ca-439f-bc38-9be35c8df886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:59.402518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a704c9-80ca-439f-bc38-9be35c8df886 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.402792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a704c9-80ca-439f-bc38-9be35c8df886 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.403060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a704c9-80ca-439f-bc38-9be35c8df886 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.415526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a704c9-80ca-439f-bc38-9be35c8df886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-88a704c9-80ca-439f-bc38-9be35c8df886 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:59.422666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:59.423570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:59.424366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 112/215] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:12:59.429948 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4bd00-1f4d-485c-b2a9-bedb81093a09 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:59.496325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:59.511933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a704c9-80ca-439f-bc38-9be35c8df886 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:59.532723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:59.540928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4bd00-1f4d-485c-b2a9-bedb81093a09 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:59.577258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaf421-38f0-4656-9cb1-65bb0877d631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:59.577954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaf421-38f0-4656-9cb1-65bb0877d631 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.578224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaf421-38f0-4656-9cb1-65bb0877d631 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.578502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaf421-38f0-4656-9cb1-65bb0877d631 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.579218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beaf421-38f0-4656-9cb1-65bb0877d631 None admin] RBAC: Adding query filter params (name=member) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:59.579524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beaf421-38f0-4656-9cb1-65bb0877d631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:59.581010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beaf421-38f0-4656-9cb1-65bb0877d631 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:59.590072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 104/216] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:12:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:59.590753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaf421-38f0-4656-9cb1-65bb0877d631 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:59.641170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a704c9-80ca-439f-bc38-9be35c8df886 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:59.679389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1c1ff-85f9-4b7c-b2ec-d880e9c6ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:59.680052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1c1ff-85f9-4b7c-b2ec-d880e9c6ce70 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.680292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1c1ff-85f9-4b7c-b2ec-d880e9c6ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.680608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1c1ff-85f9-4b7c-b2ec-d880e9c6ce70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.692003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1c1ff-85f9-4b7c-b2ec-d880e9c6ce70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-13b1c1ff-85f9-4b7c-b2ec-d880e9c6ce70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:12:59.697186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:12:59.698055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:12:59.698834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 113/217] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:12:59.699499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1c1ff-85f9-4b7c-b2ec-d880e9c6ce70 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:59.708064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaf421-38f0-4656-9cb1-65bb0877d631 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:59.734243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:59.746690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa59396-dd6b-48dd-b2ff-324071cbe4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:59.747335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa59396-dd6b-48dd-b2ff-324071cbe4bc None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.747910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa59396-dd6b-48dd-b2ff-324071cbe4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.748185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa59396-dd6b-48dd-b2ff-324071cbe4bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.749338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa59396-dd6b-48dd-b2ff-324071cbe4bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:59.750799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa59396-dd6b-48dd-b2ff-324071cbe4bc None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:59.752670 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 105/218] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:12:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:59.753228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa59396-dd6b-48dd-b2ff-324071cbe4bc None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:59.778123 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:59.807722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1c1ff-85f9-4b7c-b2ec-d880e9c6ce70 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:59.842312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6db87-7da1-403e-a449-584b92ec1bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:59.842946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6db87-7da1-403e-a449-584b92ec1bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.843220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6db87-7da1-403e-a449-584b92ec1bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.843491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6db87-7da1-403e-a449-584b92ec1bd0 None admin] PATH_INFO: `/v3/users/4b61465dc03c43609c7dccf88974cfca` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.850822 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa59396-dd6b-48dd-b2ff-324071cbe4bc None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:59.856267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6db87-7da1-403e-a449-584b92ec1bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=4b61465dc03c43609c7dccf88974cfca)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:59.857817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6db87-7da1-403e-a449-584b92ec1bd0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:59.859412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 114/219] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:12:59 2022] GET /identity/v3/users/4b61465dc03c43609c7dccf88974cfca => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:59.860717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306df0-9711-4cb6-b069-15d4de672c1d None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.861000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306df0-9711-4cb6-b069-15d4de672c1d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.861275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306df0-9711-4cb6-b069-15d4de672c1d None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.862479 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 115/220] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:59.864543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1306df0-9711-4cb6-b069-15d4de672c1d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:59.888207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4180d-a2e2-469c-beb8-ebafbfcd82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:59.888848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4180d-a2e2-469c-beb8-ebafbfcd82e7 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:59.889126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4180d-a2e2-469c-beb8-ebafbfcd82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:59.889395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4180d-a2e2-469c-beb8-ebafbfcd82e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:59.890058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4180d-a2e2-469c-beb8-ebafbfcd82e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:12:59.890359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4180d-a2e2-469c-beb8-ebafbfcd82e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:59.891785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4180d-a2e2-469c-beb8-ebafbfcd82e7 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:59.900431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 106/221] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:12:59.900711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4180d-a2e2-469c-beb8-ebafbfcd82e7 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:59.956585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:59.969731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1306df0-9711-4cb6-b069-15d4de672c1d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:59.998491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:00.001146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4180d-a2e2-469c-beb8-ebafbfcd82e7 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:00.004663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd480d7a-e766-453d-ad87-7636629e4691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:00.005280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd480d7a-e766-453d-ad87-7636629e4691 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:00.005559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd480d7a-e766-453d-ad87-7636629e4691 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:00.005857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd480d7a-e766-453d-ad87-7636629e4691 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:00.006514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd480d7a-e766-453d-ad87-7636629e4691 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:00.007985 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd480d7a-e766-453d-ad87-7636629e4691 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:00.029867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 116/222] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:12:59 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:13:00.031081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4a3fd-8235-4d70-a8ec-3e5c849cfe71 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:00.031372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4a3fd-8235-4d70-a8ec-3e5c849cfe71 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:00.031631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4a3fd-8235-4d70-a8ec-3e5c849cfe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:00.036154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6512f-a594-4821-8a9b-e25f70e46ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:00.036821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6512f-a594-4821-8a9b-e25f70e46ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:00.037160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6512f-a594-4821-8a9b-e25f70e46ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:00.037437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6512f-a594-4821-8a9b-e25f70e46ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:00.058560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-49a4a3fd-8235-4d70-a8ec-3e5c849cfe71 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:00.059798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-49a4a3fd-8235-4d70-a8ec-3e5c849cfe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:00.113508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6512f-a594-4821-8a9b-e25f70e46ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:00.115076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6512f-a594-4821-8a9b-e25f70e46ef8 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:00.137735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 117/223] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:00.138457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4a3fd-8235-4d70-a8ec-3e5c849cfe71 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:00.203109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:00.255832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4a3fd-8235-4d70-a8ec-3e5c849cfe71 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:00.270060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 107/224] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:00.275161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:00.276603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6512f-a594-4821-8a9b-e25f70e46ef8 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:00.297740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7759-4847-4da7-a206-2b311ca00aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:00.298693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7759-4847-4da7-a206-2b311ca00aad None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:00.299248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7759-4847-4da7-a206-2b311ca00aad None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:00.299661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7759-4847-4da7-a206-2b311ca00aad None admin] PATH_INFO: `/v3/users/8be8918291d348c3b4b7d4b9981fda08` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:00.300980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa7759-4847-4da7-a206-2b311ca00aad None admin] RBAC: Authorizing `identity:get_user(user_id=8be8918291d348c3b4b7d4b9981fda08)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:00.302784 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa7759-4847-4da7-a206-2b311ca00aad None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:00.304608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 118/225] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:00 2022] GET /identity/v3/users/8be8918291d348c3b4b7d4b9981fda08 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:00.310181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7759-4847-4da7-a206-2b311ca00aad None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:00.395677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6512f-a594-4821-8a9b-e25f70e46ef8 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:00.427262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7759-4847-4da7-a206-2b311ca00aad None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:00.443447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15428dd-ada0-4b8e-800a-f1edfa5f9a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:00.444281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15428dd-ada0-4b8e-800a-f1edfa5f9a69 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:00.444674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15428dd-ada0-4b8e-800a-f1edfa5f9a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:00.444947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15428dd-ada0-4b8e-800a-f1edfa5f9a69 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:00.446104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15428dd-ada0-4b8e-800a-f1edfa5f9a69 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:00.447921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15428dd-ada0-4b8e-800a-f1edfa5f9a69 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:00.449637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 108/226] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:00 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:00.450462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15428dd-ada0-4b8e-800a-f1edfa5f9a69 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:00.471171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c000f2-d117-44a6-a4d4-e6dc9e1da1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:00.471794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c000f2-d117-44a6-a4d4-e6dc9e1da1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:00.472074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c000f2-d117-44a6-a4d4-e6dc9e1da1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:00.472347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c000f2-d117-44a6-a4d4-e6dc9e1da1b9 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:00.474377 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c000f2-d117-44a6-a4d4-e6dc9e1da1b9 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:00.475191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c000f2-d117-44a6-a4d4-e6dc9e1da1b9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:00.476829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:00.478007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 119/227] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:00 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:00.479162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c000f2-d117-44a6-a4d4-e6dc9e1da1b9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:00.544872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:00.578062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15428dd-ada0-4b8e-800a-f1edfa5f9a69 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:00.606929 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c000f2-d117-44a6-a4d4-e6dc9e1da1b9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:00.621924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf357fe6-2217-4429-9706-038fb3035874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:00.622804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf357fe6-2217-4429-9706-038fb3035874 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:00.623258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf357fe6-2217-4429-9706-038fb3035874 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:00.623812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf357fe6-2217-4429-9706-038fb3035874 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:00.640820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf357fe6-2217-4429-9706-038fb3035874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-bf357fe6-2217-4429-9706-038fb3035874 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:00.648058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:00.649169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:00.649947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:00.650556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb79287-786a-4d98-9c77-4f4d09f6d0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:00.650556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb79287-786a-4d98-9c77-4f4d09f6d0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:00.650556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb79287-786a-4d98-9c77-4f4d09f6d0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:00.650556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb79287-786a-4d98-9c77-4f4d09f6d0f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:00.651560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb79287-786a-4d98-9c77-4f4d09f6d0f5 None admin] RBAC: Adding query filter params (role.id=4debeb1d97ca4a77afef4ab92d134846, scope.project.id=07bd28977c0c409484da39a0d92ca5cf, user.id=4b61465dc03c43609c7dccf88974cfca) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:00.651935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb79287-786a-4d98-9c77-4f4d09f6d0f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:00.652757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 109/228] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:13:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:00.653684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb79287-786a-4d98-9c77-4f4d09f6d0f5 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:00.653907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf357fe6-2217-4429-9706-038fb3035874 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:00.661940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 120/229] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:00 2022] GET /identity/v3/role_assignments?user.id=4b61465dc03c43609c7dccf88974cfca&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:00.668639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb79287-786a-4d98-9c77-4f4d09f6d0f5 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:00.795197 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:00.807936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf357fe6-2217-4429-9706-038fb3035874 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:00.851917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42503cf-9893-4791-8600-352d37ff4921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:00.852661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42503cf-9893-4791-8600-352d37ff4921 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:00.852943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42503cf-9893-4791-8600-352d37ff4921 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:00.853213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42503cf-9893-4791-8600-352d37ff4921 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf/users/8be8918291d348c3b4b7d4b9981fda08/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:00.855486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42503cf-9893-4791-8600-352d37ff4921 None admin] RBAC: Authorizing `identity:create_grant(project_id=07bd28977c0c409484da39a0d92ca5cf, user_id=8be8918291d348c3b4b7d4b9981fda08, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:00.859261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42503cf-9893-4791-8600-352d37ff4921 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:00.884538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 110/230] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:13:00 2022] PUT /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf/users/8be8918291d348c3b4b7d4b9981fda08/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:00.900227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb79287-786a-4d98-9c77-4f4d09f6d0f5 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:00.919762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:00.941660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d6dd1-5257-403b-b268-9a2c4d345e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:00.942449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d6dd1-5257-403b-b268-9a2c4d345e8e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:00.942784 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d6dd1-5257-403b-b268-9a2c4d345e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:00.943161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d6dd1-5257-403b-b268-9a2c4d345e8e None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:00.944026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d6dd1-5257-403b-b268-9a2c4d345e8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:00.944470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d6dd1-5257-403b-b268-9a2c4d345e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:00.946092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d6dd1-5257-403b-b268-9a2c4d345e8e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:00.956828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 121/231] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:00.965595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42503cf-9893-4791-8600-352d37ff4921 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:01.095974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42503cf-9893-4791-8600-352d37ff4921 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:01.145557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650b780-ca4a-44be-bd08-464b5ea0760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:01.146228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650b780-ca4a-44be-bd08-464b5ea0760f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:01.146935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650b780-ca4a-44be-bd08-464b5ea0760f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:01.147240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650b780-ca4a-44be-bd08-464b5ea0760f None admin] PATH_INFO: `/v3/users/8be8918291d348c3b4b7d4b9981fda08` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:01.153308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650b780-ca4a-44be-bd08-464b5ea0760f None admin] RBAC: Authorizing `identity:get_user(user_id=8be8918291d348c3b4b7d4b9981fda08)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:01.154829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650b780-ca4a-44be-bd08-464b5ea0760f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:01.156593 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 111/232] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:00 2022] GET /identity/v3/users/8be8918291d348c3b4b7d4b9981fda08 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:01.162578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d6dd1-5257-403b-b268-9a2c4d345e8e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:01.301457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d6dd1-5257-403b-b268-9a2c4d345e8e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:01.352185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35d16d-95a8-4039-9799-949e9633b579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:01.352793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d16d-95a8-4039-9799-949e9633b579 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:01.353074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d16d-95a8-4039-9799-949e9633b579 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:01.353348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d16d-95a8-4039-9799-949e9633b579 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:01.354487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35d16d-95a8-4039-9799-949e9633b579 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:01.355969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35d16d-95a8-4039-9799-949e9633b579 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:01.357662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 122/233] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:01 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:01.363832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650b780-ca4a-44be-bd08-464b5ea0760f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:01.384914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:01.511169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650b780-ca4a-44be-bd08-464b5ea0760f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:01.551310 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569ba28-aa90-4cec-be29-48ff34c57fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:01.551983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ba28-aa90-4cec-be29-48ff34c57fa7 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:01.552265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ba28-aa90-4cec-be29-48ff34c57fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:01.552616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ba28-aa90-4cec-be29-48ff34c57fa7 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf/users/8be8918291d348c3b4b7d4b9981fda08/roles/e157fabaf96640bf8a975076a70c720d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:01.554842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569ba28-aa90-4cec-be29-48ff34c57fa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=07bd28977c0c409484da39a0d92ca5cf, user_id=8be8918291d348c3b4b7d4b9981fda08, role_id=e157fabaf96640bf8a975076a70c720d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:01.556312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569ba28-aa90-4cec-be29-48ff34c57fa7 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:01.584782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 112/234] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:13:01 2022] PUT /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf/users/8be8918291d348c3b4b7d4b9981fda08/roles/e157fabaf96640bf8a975076a70c720d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:02.831098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228af33-380d-40fc-8421-793f54978d52 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:02.831615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228af33-380d-40fc-8421-793f54978d52 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:02.831615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228af33-380d-40fc-8421-793f54978d52 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:02.833286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 123/235] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:02.836553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a8dd-6316-4ac5-9d23-7b7ebaf47c3d None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:02.837381 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a8dd-6316-4ac5-9d23-7b7ebaf47c3d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:02.837848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a8dd-6316-4ac5-9d23-7b7ebaf47c3d None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:02.839663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 113/236] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:02.844612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c795007-850a-418b-8391-f7365444f171 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:02.845931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229bf16-9b71-43b7-80e9-fc15a67450e9 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:02.846426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229bf16-9b71-43b7-80e9-fc15a67450e9 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:02.846889 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229bf16-9b71-43b7-80e9-fc15a67450e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:02.847351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c795007-850a-418b-8391-f7365444f171 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:02.850729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c795007-850a-418b-8391-f7365444f171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:02.881754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-b229bf16-9b71-43b7-80e9-fc15a67450e9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:02.883006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1c795007-850a-418b-8391-f7365444f171 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:02.884445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1c795007-850a-418b-8391-f7365444f171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:02.885807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b229bf16-9b71-43b7-80e9-fc15a67450e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:02.966346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:03.020852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:03.021697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 124/237] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:03.039433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 114/238] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:03.357735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c795007-850a-418b-8391-f7365444f171 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:03.368894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229bf16-9b71-43b7-80e9-fc15a67450e9 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:03.487303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229bf16-9b71-43b7-80e9-fc15a67450e9 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:03.502787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c795007-850a-418b-8391-f7365444f171 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:03.526309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524bd94-fd78-4b0b-9ecb-1dd4c1cc0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:03.527339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524bd94-fd78-4b0b-9ecb-1dd4c1cc0952 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:03.527816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524bd94-fd78-4b0b-9ecb-1dd4c1cc0952 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:03.528283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524bd94-fd78-4b0b-9ecb-1dd4c1cc0952 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:03.529630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524bd94-fd78-4b0b-9ecb-1dd4c1cc0952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:03.531304 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524bd94-fd78-4b0b-9ecb-1dd4c1cc0952 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:03.533232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 115/239] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:03.534562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35d8c-9e01-486c-a839-e0ec5b95c86a None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:03.535041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35d8c-9e01-486c-a839-e0ec5b95c86a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:03.535510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35d8c-9e01-486c-a839-e0ec5b95c86a None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:03.537380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 116/240] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:03.538499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35d8c-9e01-486c-a839-e0ec5b95c86a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:03.544949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c817be-c031-48ba-8f63-65aae1c0deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:03.545794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c817be-c031-48ba-8f63-65aae1c0deca None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:03.546210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c817be-c031-48ba-8f63-65aae1c0deca None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:03.546641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c817be-c031-48ba-8f63-65aae1c0deca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:03.557960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c817be-c031-48ba-8f63-65aae1c0deca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-a1c817be-c031-48ba-8f63-65aae1c0deca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:03.563057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:03.563937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:03.564895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:03.567222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 125/241] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:03.569310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d9b46-60c2-4e58-91dc-62b1303b8f6a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:03.569810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d9b46-60c2-4e58-91dc-62b1303b8f6a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:03.570293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d9b46-60c2-4e58-91dc-62b1303b8f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:03.589308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-682d9b46-60c2-4e58-91dc-62b1303b8f6a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:03.590814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-682d9b46-60c2-4e58-91dc-62b1303b8f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:03.611390 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:03.622145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:03.647701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35d8c-9e01-486c-a839-e0ec5b95c86a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:03.664659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 126/242] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:03.664659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d9b46-60c2-4e58-91dc-62b1303b8f6a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:03.687344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331a1af-e23f-4d80-959e-ea5dc7f00a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:03.687956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331a1af-e23f-4d80-959e-ea5dc7f00a0a None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:03.688421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331a1af-e23f-4d80-959e-ea5dc7f00a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:03.688833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331a1af-e23f-4d80-959e-ea5dc7f00a0a None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:03.689724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331a1af-e23f-4d80-959e-ea5dc7f00a0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:03.691314 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331a1af-e23f-4d80-959e-ea5dc7f00a0a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:03.725984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 117/243] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:13:03 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:13:03.728346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e76fb-ba99-49bb-aefd-a1f666df9004 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:03.728914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e76fb-ba99-49bb-aefd-a1f666df9004 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:03.729354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e76fb-ba99-49bb-aefd-a1f666df9004 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:03.731101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 118/244] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:03.737647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2634b-6119-4508-a4db-508c44758f9e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:03.738615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2634b-6119-4508-a4db-508c44758f9e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:03.739282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2634b-6119-4508-a4db-508c44758f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:03.777136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4ea2634b-6119-4508-a4db-508c44758f9e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:03.778382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4ea2634b-6119-4508-a4db-508c44758f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:03.802287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d9b46-60c2-4e58-91dc-62b1303b8f6a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:03.884423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ca44b-4f44-4d75-b1a8-4408cc1d4d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:03.885116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ca44b-4f44-4d75-b1a8-4408cc1d4d20 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:03.885351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ca44b-4f44-4d75-b1a8-4408cc1d4d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:03.885627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ca44b-4f44-4d75-b1a8-4408cc1d4d20 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:03.888838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ca44b-4f44-4d75-b1a8-4408cc1d4d20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:03.889196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ca44b-4f44-4d75-b1a8-4408cc1d4d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:03.890640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ca44b-4f44-4d75-b1a8-4408cc1d4d20 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:03.913074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 127/245] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:03.920209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ca44b-4f44-4d75-b1a8-4408cc1d4d20 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:03.938358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 119/246] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:03.955434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2634b-6119-4508-a4db-508c44758f9e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:03.974909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:04.036325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:04.059840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ca44b-4f44-4d75-b1a8-4408cc1d4d20 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:04.097762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2634b-6119-4508-a4db-508c44758f9e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:04.101409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cb358-857a-41c5-8b5b-82b113263c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:04.102063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb358-857a-41c5-8b5b-82b113263c42 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:04.102342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb358-857a-41c5-8b5b-82b113263c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:04.102614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb358-857a-41c5-8b5b-82b113263c42 None admin] PATH_INFO: `/v3/users/25816b990e9b4eacb50d06c7edd06754` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:04.121826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cb358-857a-41c5-8b5b-82b113263c42 None admin] RBAC: Authorizing `identity:get_user(user_id=25816b990e9b4eacb50d06c7edd06754)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:04.123320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cb358-857a-41c5-8b5b-82b113263c42 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:04.125549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 128/247] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:03 2022] GET /identity/v3/users/25816b990e9b4eacb50d06c7edd06754 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:04.131175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cb358-857a-41c5-8b5b-82b113263c42 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:04.141478 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3a4c-54a5-43fe-9085-6dda7397b6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:04.142696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3a4c-54a5-43fe-9085-6dda7397b6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:04.143167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3a4c-54a5-43fe-9085-6dda7397b6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:04.143655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3a4c-54a5-43fe-9085-6dda7397b6f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:04.158030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3a4c-54a5-43fe-9085-6dda7397b6f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-fc2e3a4c-54a5-43fe-9085-6dda7397b6f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:04.164787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:04.165679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:04.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:04.170165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 120/248] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:04.175339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3a4c-54a5-43fe-9085-6dda7397b6f1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:04.234342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:04.253373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cb358-857a-41c5-8b5b-82b113263c42 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:04.314163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700d238-4be6-498e-a98a-7bd8f7d7ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:04.315468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d238-4be6-498e-a98a-7bd8f7d7ae31 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:04.315468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d238-4be6-498e-a98a-7bd8f7d7ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:04.315468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d238-4be6-498e-a98a-7bd8f7d7ae31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:04.316368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3a4c-54a5-43fe-9085-6dda7397b6f1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:04.334463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:04.358133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007afb6-36b5-4a4d-8d84-bd0c13de9100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:04.358859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007afb6-36b5-4a4d-8d84-bd0c13de9100 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:04.359141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007afb6-36b5-4a4d-8d84-bd0c13de9100 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:04.359414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007afb6-36b5-4a4d-8d84-bd0c13de9100 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:04.360150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007afb6-36b5-4a4d-8d84-bd0c13de9100 None admin] RBAC: Adding query filter params (name=member) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:04.360532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007afb6-36b5-4a4d-8d84-bd0c13de9100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:04.361977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007afb6-36b5-4a4d-8d84-bd0c13de9100 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:04.371757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 121/249] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:04.372921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007afb6-36b5-4a4d-8d84-bd0c13de9100 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:04.396367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700d238-4be6-498e-a98a-7bd8f7d7ae31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:04.398015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700d238-4be6-498e-a98a-7bd8f7d7ae31 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:04.493941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007afb6-36b5-4a4d-8d84-bd0c13de9100 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:04.507058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:04.528168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 129/250] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:13:04.529227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700d238-4be6-498e-a98a-7bd8f7d7ae31 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:04.540512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d469d7a-ed31-480d-92e2-4be1c57c5966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:04.541214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469d7a-ed31-480d-92e2-4be1c57c5966 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:04.541494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469d7a-ed31-480d-92e2-4be1c57c5966 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:04.541763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469d7a-ed31-480d-92e2-4be1c57c5966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:04.553790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d469d7a-ed31-480d-92e2-4be1c57c5966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-5d469d7a-ed31-480d-92e2-4be1c57c5966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:04.561284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:04.562184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:13:04.562982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:04.568446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 122/251] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:13:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:04.570303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4c5f9-c4d0-428a-b68b-068f741907a3 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:04.570713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4c5f9-c4d0-428a-b68b-068f741907a3 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:04.570994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4c5f9-c4d0-428a-b68b-068f741907a3 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:04.573006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 123/252] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:04.573721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4c5f9-c4d0-428a-b68b-068f741907a3 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:04.617375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:04.662717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700d238-4be6-498e-a98a-7bd8f7d7ae31 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:04.697152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4c5f9-c4d0-428a-b68b-068f741907a3 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:04.709077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13507b26-3e76-4a60-81d2-6cdd5ae67fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:04.710210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13507b26-3e76-4a60-81d2-6cdd5ae67fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:04.710496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13507b26-3e76-4a60-81d2-6cdd5ae67fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:04.711192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13507b26-3e76-4a60-81d2-6cdd5ae67fc3 None admin] PATH_INFO: `/v3/users/4b61465dc03c43609c7dccf88974cfca` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:04.712672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13507b26-3e76-4a60-81d2-6cdd5ae67fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=4b61465dc03c43609c7dccf88974cfca)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:04.714864 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13507b26-3e76-4a60-81d2-6cdd5ae67fc3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:04.717328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 130/253] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:04 2022] GET /identity/v3/users/4b61465dc03c43609c7dccf88974cfca => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:04.718571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13507b26-3e76-4a60-81d2-6cdd5ae67fc3 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:04.739147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4957d44-a80c-4a97-a147-92e84f158bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:04.739792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4957d44-a80c-4a97-a147-92e84f158bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:04.740585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4957d44-a80c-4a97-a147-92e84f158bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:04.740855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4957d44-a80c-4a97-a147-92e84f158bf6 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:04.742476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4957d44-a80c-4a97-a147-92e84f158bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:04.744034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4957d44-a80c-4a97-a147-92e84f158bf6 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:04.746571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 124/254] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:04 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:04.747909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46310-d41e-44bd-a823-6e6ba767bdff None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:04.748189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46310-d41e-44bd-a823-6e6ba767bdff None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:04.748495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46310-d41e-44bd-a823-6e6ba767bdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:04.776484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-bcd46310-d41e-44bd-a823-6e6ba767bdff None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:04.778121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-bcd46310-d41e-44bd-a823-6e6ba767bdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:04.797995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:04.856312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13507b26-3e76-4a60-81d2-6cdd5ae67fc3 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:04.856531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 125/255] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:04.857427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd46310-d41e-44bd-a823-6e6ba767bdff None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:04.907695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:04.913846 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73258373-5c5f-463f-a076-bc76850e338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:04.915099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258373-5c5f-463f-a076-bc76850e338b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:04.915592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258373-5c5f-463f-a076-bc76850e338b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:04.919704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258373-5c5f-463f-a076-bc76850e338b None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:04.920672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73258373-5c5f-463f-a076-bc76850e338b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:04.921236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73258373-5c5f-463f-a076-bc76850e338b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:04.922838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73258373-5c5f-463f-a076-bc76850e338b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:04.946858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 131/256] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:04.948121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73258373-5c5f-463f-a076-bc76850e338b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:05.028472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd46310-d41e-44bd-a823-6e6ba767bdff None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:05.064308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee6706-bfa8-4003-ba37-330d35596eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:05.065499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee6706-bfa8-4003-ba37-330d35596eaf None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:05.065977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee6706-bfa8-4003-ba37-330d35596eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:05.066467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee6706-bfa8-4003-ba37-330d35596eaf None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:05.067807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee6706-bfa8-4003-ba37-330d35596eaf None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:05.069684 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee6706-bfa8-4003-ba37-330d35596eaf None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:05.072213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 126/257] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:04 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:05.073209 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee6706-bfa8-4003-ba37-330d35596eaf None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:05.179948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73258373-5c5f-463f-a076-bc76850e338b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:05.184990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee6706-bfa8-4003-ba37-330d35596eaf None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:05.186949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:05.214779 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:05.225452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e729d-f10d-452a-ad97-2b4b031d8e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:05.226162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e729d-f10d-452a-ad97-2b4b031d8e84 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:05.226507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e729d-f10d-452a-ad97-2b4b031d8e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:05.226852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e729d-f10d-452a-ad97-2b4b031d8e84 None admin] PATH_INFO: `/v3/users/8be8918291d348c3b4b7d4b9981fda08` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:05.228043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e729d-f10d-452a-ad97-2b4b031d8e84 None admin] RBAC: Authorizing `identity:get_user(user_id=8be8918291d348c3b4b7d4b9981fda08)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:05.228991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e3d42-e6f0-4a2a-9a19-0b8a9dbf2c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:05.229850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3d42-e6f0-4a2a-9a19-0b8a9dbf2c22 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:05.230238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e729d-f10d-452a-ad97-2b4b031d8e84 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:05.230556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3d42-e6f0-4a2a-9a19-0b8a9dbf2c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:05.230997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3d42-e6f0-4a2a-9a19-0b8a9dbf2c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:05.231888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e3d42-e6f0-4a2a-9a19-0b8a9dbf2c22 None admin] RBAC: Adding query filter params (role.id=908a16375c894bac957d576ea917ac03, scope.project.id=07bd28977c0c409484da39a0d92ca5cf, user.id=25816b990e9b4eacb50d06c7edd06754) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:05.232360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e3d42-e6f0-4a2a-9a19-0b8a9dbf2c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:05.234100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e3d42-e6f0-4a2a-9a19-0b8a9dbf2c22 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:05.236582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 127/258] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:05 2022] GET /identity/v3/users/8be8918291d348c3b4b7d4b9981fda08 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:05.237388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e729d-f10d-452a-ad97-2b4b031d8e84 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:05.241008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 132/259] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:04 2022] GET /identity/v3/role_assignments?user.id=25816b990e9b4eacb50d06c7edd06754&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=908a16375c894bac957d576ea917ac03 => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:05.243240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e3d42-e6f0-4a2a-9a19-0b8a9dbf2c22 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:05.440610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e3d42-e6f0-4a2a-9a19-0b8a9dbf2c22 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:05.442366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e729d-f10d-452a-ad97-2b4b031d8e84 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:05.486103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b8eb0-c954-440c-b292-68a44ca13330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:05.486746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b8eb0-c954-440c-b292-68a44ca13330 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:05.487079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b8eb0-c954-440c-b292-68a44ca13330 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:05.487356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b8eb0-c954-440c-b292-68a44ca13330 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:05.498541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b8eb0-c954-440c-b292-68a44ca13330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-262b8eb0-c954-440c-b292-68a44ca13330 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:05.503931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:05.504931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:05.505810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 133/260] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:13:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:05.512610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b8eb0-c954-440c-b292-68a44ca13330 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:05.529125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a54e90-df8e-4508-a88e-b7416dbd77e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:05.529824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a54e90-df8e-4508-a88e-b7416dbd77e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:05.530106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a54e90-df8e-4508-a88e-b7416dbd77e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:05.530386 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a54e90-df8e-4508-a88e-b7416dbd77e1 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf/users/4b61465dc03c43609c7dccf88974cfca/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:05.535426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a54e90-df8e-4508-a88e-b7416dbd77e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=07bd28977c0c409484da39a0d92ca5cf, user_id=4b61465dc03c43609c7dccf88974cfca, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:05.537074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a54e90-df8e-4508-a88e-b7416dbd77e1 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:05.550248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:05.577424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 128/261] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:13:05 2022] PUT /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf/users/4b61465dc03c43609c7dccf88974cfca/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:05.578280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a54e90-df8e-4508-a88e-b7416dbd77e1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:05.641987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b8eb0-c954-440c-b292-68a44ca13330 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:05.659355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:05.713356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae72ef-f6cf-49d0-9733-f42929de687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:05.713919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae72ef-f6cf-49d0-9733-f42929de687e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:05.714200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae72ef-f6cf-49d0-9733-f42929de687e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:05.714475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae72ef-f6cf-49d0-9733-f42929de687e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:05.838301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a54e90-df8e-4508-a88e-b7416dbd77e1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:05.865451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae72ef-f6cf-49d0-9733-f42929de687e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:05.867332 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae72ef-f6cf-49d0-9733-f42929de687e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:05.875218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0ef11-d45c-4f52-a1fd-c0d1456fa026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:05.875841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0ef11-d45c-4f52-a1fd-c0d1456fa026 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:05.876121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0ef11-d45c-4f52-a1fd-c0d1456fa026 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:05.876418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0ef11-d45c-4f52-a1fd-c0d1456fa026 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:05.877100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0ef11-d45c-4f52-a1fd-c0d1456fa026 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:05.877406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0ef11-d45c-4f52-a1fd-c0d1456fa026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:05.878804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0ef11-d45c-4f52-a1fd-c0d1456fa026 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:05.887866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 129/262] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:05.895073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0ef11-d45c-4f52-a1fd-c0d1456fa026 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:05.952264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:06.051821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0ef11-d45c-4f52-a1fd-c0d1456fa026 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:06.052410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 134/263] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:06.054262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:06.058516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae72ef-f6cf-49d0-9733-f42929de687e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:06.134587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aac9b4-64e4-4f0a-8d1e-6dab01d5e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:06.135546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aac9b4-64e4-4f0a-8d1e-6dab01d5e423 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:06.136184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aac9b4-64e4-4f0a-8d1e-6dab01d5e423 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:06.136636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aac9b4-64e4-4f0a-8d1e-6dab01d5e423 None admin] PATH_INFO: `/v3/users/8be8918291d348c3b4b7d4b9981fda08` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:06.138661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aac9b4-64e4-4f0a-8d1e-6dab01d5e423 None admin] RBAC: Authorizing `identity:get_user(user_id=8be8918291d348c3b4b7d4b9981fda08)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:06.140132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aac9b4-64e4-4f0a-8d1e-6dab01d5e423 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:06.148488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 130/264] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:05 2022] GET /identity/v3/users/8be8918291d348c3b4b7d4b9981fda08 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:06.149465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aac9b4-64e4-4f0a-8d1e-6dab01d5e423 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:06.230068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae72ef-f6cf-49d0-9733-f42929de687e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:06.274944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b724ea-5a2a-4b95-83c0-2806d2f3f9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:06.275725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b724ea-5a2a-4b95-83c0-2806d2f3f9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:06.276007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b724ea-5a2a-4b95-83c0-2806d2f3f9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:06.276284 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b724ea-5a2a-4b95-83c0-2806d2f3f9e3 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:06.277717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b724ea-5a2a-4b95-83c0-2806d2f3f9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:06.279277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b724ea-5a2a-4b95-83c0-2806d2f3f9e3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:06.282055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 135/265] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:06 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:06.287122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b724ea-5a2a-4b95-83c0-2806d2f3f9e3 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:06.308660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:06.336341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aac9b4-64e4-4f0a-8d1e-6dab01d5e423 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:06.375530 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341b716-fe2b-4478-92b7-e7e46784425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:06.376170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341b716-fe2b-4478-92b7-e7e46784425c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:06.376473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341b716-fe2b-4478-92b7-e7e46784425c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:06.376757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341b716-fe2b-4478-92b7-e7e46784425c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:06.407974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:06.452046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341b716-fe2b-4478-92b7-e7e46784425c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:06.453565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341b716-fe2b-4478-92b7-e7e46784425c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:06.493528 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b724ea-5a2a-4b95-83c0-2806d2f3f9e3 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:06.557437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 131/266] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:06.563103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341b716-fe2b-4478-92b7-e7e46784425c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:06.585755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38a2ac-18db-434e-a3c3-df7fb1324167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:06.586398 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38a2ac-18db-434e-a3c3-df7fb1324167 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:06.586675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38a2ac-18db-434e-a3c3-df7fb1324167 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:06.586945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38a2ac-18db-434e-a3c3-df7fb1324167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:06.587676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38a2ac-18db-434e-a3c3-df7fb1324167 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=07bd28977c0c409484da39a0d92ca5cf, user.id=8be8918291d348c3b4b7d4b9981fda08) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:06.587982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38a2ac-18db-434e-a3c3-df7fb1324167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:06.589478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38a2ac-18db-434e-a3c3-df7fb1324167 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:06.610569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 136/267] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:06 2022] GET /identity/v3/role_assignments?user.id=8be8918291d348c3b4b7d4b9981fda08&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=71bed99a52684ba990097719b40ef99d => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:06.627650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:06.676033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341b716-fe2b-4478-92b7-e7e46784425c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:06.737918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d31ad-1830-4d60-8c01-1cf4d7070188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:06.738937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d31ad-1830-4d60-8c01-1cf4d7070188 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:06.739394 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d31ad-1830-4d60-8c01-1cf4d7070188 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:06.739900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d31ad-1830-4d60-8c01-1cf4d7070188 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:06.745201 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d31ad-1830-4d60-8c01-1cf4d7070188 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:06.746954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d31ad-1830-4d60-8c01-1cf4d7070188 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:06.748916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 132/268] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:06 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:06.757700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38a2ac-18db-434e-a3c3-df7fb1324167 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:06.782704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d4ed-c0bb-4549-a1be-414fd378b972 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:06.783281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d4ed-c0bb-4549-a1be-414fd378b972 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:06.783760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d4ed-c0bb-4549-a1be-414fd378b972 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:06.785365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 133/269] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:13:06.790916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ea71a-2874-427a-a0aa-941e3b4494e4 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:06.791437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ea71a-2874-427a-a0aa-941e3b4494e4 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:06.791912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ea71a-2874-427a-a0aa-941e3b4494e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:06.819444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e13ea71a-2874-427a-a0aa-941e3b4494e4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:06.821822 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e13ea71a-2874-427a-a0aa-941e3b4494e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:06.893928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:06.931641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38a2ac-18db-434e-a3c3-df7fb1324167 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:06.969397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 134/270] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:06.977463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1839e8-4f60-4af6-9613-aebd17be3e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:06.978727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1839e8-4f60-4af6-9613-aebd17be3e29 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:06.979182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1839e8-4f60-4af6-9613-aebd17be3e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:06.979659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1839e8-4f60-4af6-9613-aebd17be3e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:06.980591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1839e8-4f60-4af6-9613-aebd17be3e29 None admin] RBAC: Adding query filter params (role.id=e157fabaf96640bf8a975076a70c720d, scope.project.id=07bd28977c0c409484da39a0d92ca5cf, user.id=8be8918291d348c3b4b7d4b9981fda08) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:06.981104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1839e8-4f60-4af6-9613-aebd17be3e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:06.982735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1839e8-4f60-4af6-9613-aebd17be3e29 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:06.989176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 137/271] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:06 2022] GET /identity/v3/role_assignments?user.id=8be8918291d348c3b4b7d4b9981fda08&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=e157fabaf96640bf8a975076a70c720d => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:07.340834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe11e-6fb6-46e1-be21-3ce66a881a6c None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:07.341358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe11e-6fb6-46e1-be21-3ce66a881a6c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:07.341358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe11e-6fb6-46e1-be21-3ce66a881a6c None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:07.343076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 135/272] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:07.348309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563061b-f3b3-4f0c-ab9d-b973eb53092c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:07.348821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563061b-f3b3-4f0c-ab9d-b973eb53092c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:07.349349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563061b-f3b3-4f0c-ab9d-b973eb53092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:07.365309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe11e-6fb6-46e1-be21-3ce66a881a6c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:07.372439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-c563061b-f3b3-4f0c-ab9d-b973eb53092c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:07.373910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c563061b-f3b3-4f0c-ab9d-b973eb53092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:07.464257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:07.466700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 138/273] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:07.515471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe11e-6fb6-46e1-be21-3ce66a881a6c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:07.562378 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e053759-253e-45e7-aca1-47c5364bc47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:07.563411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e053759-253e-45e7-aca1-47c5364bc47d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:07.563887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e053759-253e-45e7-aca1-47c5364bc47d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:07.564487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e053759-253e-45e7-aca1-47c5364bc47d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:07.576199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e053759-253e-45e7-aca1-47c5364bc47d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-0e053759-253e-45e7-aca1-47c5364bc47d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:07.581537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:07.582428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:07.583239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:07.585617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 136/274] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:07.591681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563061b-f3b3-4f0c-ab9d-b973eb53092c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:07.659337 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:07.695466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563061b-f3b3-4f0c-ab9d-b973eb53092c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:07.732363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5b6a1-8d3d-461a-8bc1-1905a82451c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:07.733020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5b6a1-8d3d-461a-8bc1-1905a82451c9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:07.733297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5b6a1-8d3d-461a-8bc1-1905a82451c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:07.733566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5b6a1-8d3d-461a-8bc1-1905a82451c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:07.734252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5b6a1-8d3d-461a-8bc1-1905a82451c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:07.734560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5b6a1-8d3d-461a-8bc1-1905a82451c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:07.735972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5b6a1-8d3d-461a-8bc1-1905a82451c9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:07.751306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 139/275] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:07.756035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e053759-253e-45e7-aca1-47c5364bc47d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:07.756649 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5b6a1-8d3d-461a-8bc1-1905a82451c9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:07.863905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5b6a1-8d3d-461a-8bc1-1905a82451c9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:07.875105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e053759-253e-45e7-aca1-47c5364bc47d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:07.892335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:07.894019 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:07.903466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63921448-9906-4cf0-acfd-276e85f7d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:07.904109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921448-9906-4cf0-acfd-276e85f7d20f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:07.904411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921448-9906-4cf0-acfd-276e85f7d20f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:07.904683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921448-9906-4cf0-acfd-276e85f7d20f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:07.905814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63921448-9906-4cf0-acfd-276e85f7d20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:07.907532 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63921448-9906-4cf0-acfd-276e85f7d20f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:07.912566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 140/276] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:07.912566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd87e3-0cb3-4a13-beb2-07d22f7993ce None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:07.912566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd87e3-0cb3-4a13-beb2-07d22f7993ce None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:07.912566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd87e3-0cb3-4a13-beb2-07d22f7993ce None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:07.912566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 141/277] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:07.916931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd87e3-0cb3-4a13-beb2-07d22f7993ce None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:07.921363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc34e3e-7489-41b6-a31d-191fcda9df67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:07.922229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34e3e-7489-41b6-a31d-191fcda9df67 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:07.922654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34e3e-7489-41b6-a31d-191fcda9df67 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:07.923073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34e3e-7489-41b6-a31d-191fcda9df67 None admin] PATH_INFO: `/v3/users/3956fc9953b5453cb3bdd22a841b0bdf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:07.939858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc34e3e-7489-41b6-a31d-191fcda9df67 None admin] RBAC: Authorizing `identity:get_user(user_id=3956fc9953b5453cb3bdd22a841b0bdf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:07.941367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc34e3e-7489-41b6-a31d-191fcda9df67 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:07.943234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 137/278] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:07 2022] GET /identity/v3/users/3956fc9953b5453cb3bdd22a841b0bdf => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:07.944678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87a45-facc-414c-aa35-2f38fdef6150 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:07.944812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87a45-facc-414c-aa35-2f38fdef6150 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:07.945073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87a45-facc-414c-aa35-2f38fdef6150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:07.963381 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-83a87a45-facc-414c-aa35-2f38fdef6150 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:07.964580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-83a87a45-facc-414c-aa35-2f38fdef6150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:08.038517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 138/279] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:08.039689 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a87a45-facc-414c-aa35-2f38fdef6150 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:08.049291 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd87e3-0cb3-4a13-beb2-07d22f7993ce None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:08.087861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf0784-0ea8-4089-b1f4-5f7e79338d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:08.088760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0784-0ea8-4089-b1f4-5f7e79338d56 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:08.089183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0784-0ea8-4089-b1f4-5f7e79338d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:08.089758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0784-0ea8-4089-b1f4-5f7e79338d56 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:08.090694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf0784-0ea8-4089-b1f4-5f7e79338d56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:08.092346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf0784-0ea8-4089-b1f4-5f7e79338d56 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:08.131726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 142/280] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:13:07 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:13:08.151788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a87a45-facc-414c-aa35-2f38fdef6150 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:08.160976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:08.195317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7a752-7796-496c-bc66-d7fb1ac21cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:08.195950 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a752-7796-496c-bc66-d7fb1ac21cbd None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:08.196596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a752-7796-496c-bc66-d7fb1ac21cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:08.196869 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a752-7796-496c-bc66-d7fb1ac21cbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:08.197619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7a752-7796-496c-bc66-d7fb1ac21cbd None admin] RBAC: Adding query filter params (role.id=4debeb1d97ca4a77afef4ab92d134846, user.id=3956fc9953b5453cb3bdd22a841b0bdf, scope.system=all) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:08.197927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7a752-7796-496c-bc66-d7fb1ac21cbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:08.199411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7a752-7796-496c-bc66-d7fb1ac21cbd None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:08.212757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 139/281] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Sep 16 19:13:08 2022] GET /identity/v3/role_assignments?user.id=3956fc9953b5453cb3bdd22a841b0bdf&scope.system=all&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:08.323714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf0784-0ea8-4089-b1f4-5f7e79338d56 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:08.386939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:08.444626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf0784-0ea8-4089-b1f4-5f7e79338d56 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:08.481630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2813e-1e0f-430b-a481-d3d26bac442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:08.482275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2813e-1e0f-430b-a481-d3d26bac442a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:08.482559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2813e-1e0f-430b-a481-d3d26bac442a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:08.482823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2813e-1e0f-430b-a481-d3d26bac442a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:08.493677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2813e-1e0f-430b-a481-d3d26bac442a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-dab2813e-1e0f-430b-a481-d3d26bac442a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:08.499757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:08.500647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:08.501434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 143/282] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:08.506909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7a752-7796-496c-bc66-d7fb1ac21cbd None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:08.553982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423e13d-6dc0-434f-b98f-320e5c35f7ae None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:08.554314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423e13d-6dc0-434f-b98f-320e5c35f7ae None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:08.554542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423e13d-6dc0-434f-b98f-320e5c35f7ae None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:08.556232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 144/283] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:13:08.561766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c711acc-c601-4f76-924b-a0113833d485 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:08.562053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c711acc-c601-4f76-924b-a0113833d485 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:08.562322 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c711acc-c601-4f76-924b-a0113833d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:08.589783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-2c711acc-c601-4f76-924b-a0113833d485 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:08.591714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2c711acc-c601-4f76-924b-a0113833d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:08.639017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7a752-7796-496c-bc66-d7fb1ac21cbd None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:08.672212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 145/284] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:08.680709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f281a05-b585-44a7-aeb2-373da36d0cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:08.681490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281a05-b585-44a7-aeb2-373da36d0cee None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:08.681764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281a05-b585-44a7-aeb2-373da36d0cee None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:08.682032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281a05-b585-44a7-aeb2-373da36d0cee None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:08.682707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f281a05-b585-44a7-aeb2-373da36d0cee None admin] RBAC: Adding query filter params (name=reader) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:08.683006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f281a05-b585-44a7-aeb2-373da36d0cee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:08.684410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f281a05-b585-44a7-aeb2-373da36d0cee None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:08.693783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 140/285] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:08.699523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c711acc-c601-4f76-924b-a0113833d485 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:08.747611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:08.815181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c711acc-c601-4f76-924b-a0113833d485 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:08.859168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bec1e-8159-42a6-8794-00064fbbf2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:08.859872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bec1e-8159-42a6-8794-00064fbbf2df None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:08.860158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bec1e-8159-42a6-8794-00064fbbf2df None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:08.860467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bec1e-8159-42a6-8794-00064fbbf2df None admin] PATH_INFO: `/v3/users/25816b990e9b4eacb50d06c7edd06754` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:08.861614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bec1e-8159-42a6-8794-00064fbbf2df None admin] RBAC: Authorizing `identity:get_user(user_id=25816b990e9b4eacb50d06c7edd06754)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:08.863078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bec1e-8159-42a6-8794-00064fbbf2df None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:08.865062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 146/286] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:08 2022] GET /identity/v3/users/25816b990e9b4eacb50d06c7edd06754 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:08.870629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f281a05-b585-44a7-aeb2-373da36d0cee None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:08.933022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:09.032056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f281a05-b585-44a7-aeb2-373da36d0cee None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:09.067897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bec1e-8159-42a6-8794-00064fbbf2df None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:09.079411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b2d76-7dff-4283-a6c5-bdb3da54776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:09.080060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2d76-7dff-4283-a6c5-bdb3da54776f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:09.080332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2d76-7dff-4283-a6c5-bdb3da54776f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:09.080631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2d76-7dff-4283-a6c5-bdb3da54776f None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:09.081759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b2d76-7dff-4283-a6c5-bdb3da54776f None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:09.083239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b2d76-7dff-4283-a6c5-bdb3da54776f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:09.087480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 141/287] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:08 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:09.097345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b2d76-7dff-4283-a6c5-bdb3da54776f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:09.231288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bec1e-8159-42a6-8794-00064fbbf2df None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:09.253867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:09.273186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:09.278302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b2d76-7dff-4283-a6c5-bdb3da54776f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:09.306977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da8741-3fb5-4127-8baa-a7a48f27bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:09.308739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da8741-3fb5-4127-8baa-a7a48f27bf5b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:09.309385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da8741-3fb5-4127-8baa-a7a48f27bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:09.312281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da8741-3fb5-4127-8baa-a7a48f27bf5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:09.332658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da8741-3fb5-4127-8baa-a7a48f27bf5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-f3da8741-3fb5-4127-8baa-a7a48f27bf5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:09.340821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:09.341719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:09.342519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:09.346803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 147/288] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:09.353329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da8741-3fb5-4127-8baa-a7a48f27bf5b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:09.366918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73388381-bb06-4073-9475-536077c887d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:09.367945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73388381-bb06-4073-9475-536077c887d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:09.368498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73388381-bb06-4073-9475-536077c887d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:09.368968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73388381-bb06-4073-9475-536077c887d2 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf/users/25816b990e9b4eacb50d06c7edd06754/roles/908a16375c894bac957d576ea917ac03` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:09.373654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73388381-bb06-4073-9475-536077c887d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=07bd28977c0c409484da39a0d92ca5cf, user_id=25816b990e9b4eacb50d06c7edd06754, role_id=908a16375c894bac957d576ea917ac03)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:09.375426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73388381-bb06-4073-9475-536077c887d2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:09.405328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 142/289] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:13:09 2022] PUT /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf/users/25816b990e9b4eacb50d06c7edd06754/roles/908a16375c894bac957d576ea917ac03 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:09.551931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da8741-3fb5-4127-8baa-a7a48f27bf5b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:09.593413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd13f2c-2c29-4884-b3c8-78d74f970ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:09.594406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13f2c-2c29-4884-b3c8-78d74f970ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:09.594879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13f2c-2c29-4884-b3c8-78d74f970ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:09.595368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13f2c-2c29-4884-b3c8-78d74f970ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:09.596236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd13f2c-2c29-4884-b3c8-78d74f970ec7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:09.596824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd13f2c-2c29-4884-b3c8-78d74f970ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:09.598437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd13f2c-2c29-4884-b3c8-78d74f970ec7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:09.608862 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 148/290] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:09.617619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73388381-bb06-4073-9475-536077c887d2 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:09.731116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73388381-bb06-4073-9475-536077c887d2 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:09.772419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f18fe2-25b4-4149-b44c-48753bf5c144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:09.772419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18fe2-25b4-4149-b44c-48753bf5c144 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:09.772419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18fe2-25b4-4149-b44c-48753bf5c144 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:09.772419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18fe2-25b4-4149-b44c-48753bf5c144 None admin] PATH_INFO: `/v3/users/4b61465dc03c43609c7dccf88974cfca` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:09.772763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f18fe2-25b4-4149-b44c-48753bf5c144 None admin] RBAC: Authorizing `identity:get_user(user_id=4b61465dc03c43609c7dccf88974cfca)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:09.772763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f18fe2-25b4-4149-b44c-48753bf5c144 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:09.773914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 143/291] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:09 2022] GET /identity/v3/users/4b61465dc03c43609c7dccf88974cfca => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:09.780282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd13f2c-2c29-4884-b3c8-78d74f970ec7 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:09.827264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:09.923370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd13f2c-2c29-4884-b3c8-78d74f970ec7 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:09.967098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce4a1c-224c-4956-9f4c-396597b45c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:09.967717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4a1c-224c-4956-9f4c-396597b45c3a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:09.967998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4a1c-224c-4956-9f4c-396597b45c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:09.968270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4a1c-224c-4956-9f4c-396597b45c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:10.062383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce4a1c-224c-4956-9f4c-396597b45c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:10.063882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce4a1c-224c-4956-9f4c-396597b45c3a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:10.103711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:10.181917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 149/292] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:10.187675 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f18fe2-25b4-4149-b44c-48753bf5c144 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:10.220659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:10.312728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f18fe2-25b4-4149-b44c-48753bf5c144 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:10.356321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad224c0-6708-4a7a-b9eb-5a8e7b75e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:10.356918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad224c0-6708-4a7a-b9eb-5a8e7b75e046 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:10.357199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad224c0-6708-4a7a-b9eb-5a8e7b75e046 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:10.357468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad224c0-6708-4a7a-b9eb-5a8e7b75e046 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:10.358643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad224c0-6708-4a7a-b9eb-5a8e7b75e046 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:10.360098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad224c0-6708-4a7a-b9eb-5a8e7b75e046 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:10.362094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 144/293] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:10 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:10.368042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce4a1c-224c-4956-9f4c-396597b45c3a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:10.511647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce4a1c-224c-4956-9f4c-396597b45c3a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:10.547238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:10.552921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e2b8a-22d6-40d2-944d-3797f9ef6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:10.553719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2b8a-22d6-40d2-944d-3797f9ef6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:10.554249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2b8a-22d6-40d2-944d-3797f9ef6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:10.554446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2b8a-22d6-40d2-944d-3797f9ef6ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:10.555185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e2b8a-22d6-40d2-944d-3797f9ef6ae9 None admin] RBAC: Adding query filter params (role.id=4debeb1d97ca4a77afef4ab92d134846, scope.project.id=07bd28977c0c409484da39a0d92ca5cf, user.id=4b61465dc03c43609c7dccf88974cfca) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:10.555496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e2b8a-22d6-40d2-944d-3797f9ef6ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:10.556991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e2b8a-22d6-40d2-944d-3797f9ef6ae9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:10.563287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 150/294] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:10 2022] GET /identity/v3/role_assignments?user.id=4b61465dc03c43609c7dccf88974cfca&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:10.582683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5c3e-79b6-4a56-9ab3-37e965c08752 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:10.583389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5c3e-79b6-4a56-9ab3-37e965c08752 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:10.583857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5c3e-79b6-4a56-9ab3-37e965c08752 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:10.585561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 145/295] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:10.591748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6253c3-bbfe-4dd4-ba82-a6911bd4e86b None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:10.592435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6253c3-bbfe-4dd4-ba82-a6911bd4e86b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:10.592903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6253c3-bbfe-4dd4-ba82-a6911bd4e86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:10.620798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-be6253c3-bbfe-4dd4-ba82-a6911bd4e86b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:10.622359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-be6253c3-bbfe-4dd4-ba82-a6911bd4e86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:10.729748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 151/296] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:11.005060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b5c3e-79b6-4a56-9ab3-37e965c08752 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:11.125466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:11.133655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b5c3e-79b6-4a56-9ab3-37e965c08752 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:11.180930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957cb33-9742-4a96-b04d-a0601fadc86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:11.181994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957cb33-9742-4a96-b04d-a0601fadc86e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:11.182517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957cb33-9742-4a96-b04d-a0601fadc86e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:11.182998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957cb33-9742-4a96-b04d-a0601fadc86e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:11.197060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957cb33-9742-4a96-b04d-a0601fadc86e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-e957cb33-9742-4a96-b04d-a0601fadc86e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:11.205045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:11.205962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:11.206742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:11.213040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 146/297] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:11.215705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6253c3-bbfe-4dd4-ba82-a6911bd4e86b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:11.296840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9eab-70f1-46c6-8f2d-c7c17dfa51a2 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:11.297191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9eab-70f1-46c6-8f2d-c7c17dfa51a2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:11.297394 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9eab-70f1-46c6-8f2d-c7c17dfa51a2 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:11.299299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 147/298] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:13:11.303342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704810b-0e1c-4f94-8dc6-215b650355d8 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:11.303630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704810b-0e1c-4f94-8dc6-215b650355d8 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:11.304277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704810b-0e1c-4f94-8dc6-215b650355d8 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:11.305872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 148/299] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:11.306783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8babba2-a9dc-4d36-bd8b-6263ee91ca6a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:11.307059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8babba2-a9dc-4d36-bd8b-6263ee91ca6a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:11.307331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8babba2-a9dc-4d36-bd8b-6263ee91ca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:11.319853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6253c3-bbfe-4dd4-ba82-a6911bd4e86b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:11.327190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f8babba2-a9dc-4d36-bd8b-6263ee91ca6a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:11.328410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f8babba2-a9dc-4d36-bd8b-6263ee91ca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:11.345584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:11.355873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6fc65-d97e-4e34-8df9-ab40900a1634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:11.356513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6fc65-d97e-4e34-8df9-ab40900a1634 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:11.356795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6fc65-d97e-4e34-8df9-ab40900a1634 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:11.357067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6fc65-d97e-4e34-8df9-ab40900a1634 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:11.357723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6fc65-d97e-4e34-8df9-ab40900a1634 None admin] RBAC: Adding query filter params (name=member) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:11.358022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6fc65-d97e-4e34-8df9-ab40900a1634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:11.359396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6fc65-d97e-4e34-8df9-ab40900a1634 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:11.372410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 152/300] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:11.372410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d224a7-fb0a-4c70-bdf4-1078c12d606a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:11.372410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d224a7-fb0a-4c70-bdf4-1078c12d606a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:11.372410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d224a7-fb0a-4c70-bdf4-1078c12d606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:11.388673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-73d224a7-fb0a-4c70-bdf4-1078c12d606a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:11.390360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-73d224a7-fb0a-4c70-bdf4-1078c12d606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:11.408702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 149/301] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:11.408702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8babba2-a9dc-4d36-bd8b-6263ee91ca6a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:11.481814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 153/302] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:11.496822 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:11.512555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8babba2-a9dc-4d36-bd8b-6263ee91ca6a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:11.548574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0bda1-27c5-4061-9a4d-c7bcade86a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:11.549194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0bda1-27c5-4061-9a4d-c7bcade86a05 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:11.549479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0bda1-27c5-4061-9a4d-c7bcade86a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:11.549754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0bda1-27c5-4061-9a4d-c7bcade86a05 None admin] PATH_INFO: `/v3/users/3956fc9953b5453cb3bdd22a841b0bdf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:11.550896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0bda1-27c5-4061-9a4d-c7bcade86a05 None admin] RBAC: Authorizing `identity:get_user(user_id=3956fc9953b5453cb3bdd22a841b0bdf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:11.552475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0bda1-27c5-4061-9a4d-c7bcade86a05 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:11.554418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 150/303] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:11 2022] GET /identity/v3/users/3956fc9953b5453cb3bdd22a841b0bdf => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:11.559925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d224a7-fb0a-4c70-bdf4-1078c12d606a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:11.663761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d224a7-fb0a-4c70-bdf4-1078c12d606a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:11.683328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:11.704645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfc204-1c2c-44ea-999f-b8467452daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:11.705620 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfc204-1c2c-44ea-999f-b8467452daa3 None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:11.706060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfc204-1c2c-44ea-999f-b8467452daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:11.706468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfc204-1c2c-44ea-999f-b8467452daa3 None admin] PATH_INFO: `/v3/system/users/3956fc9953b5453cb3bdd22a841b0bdf/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:11.706910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0bda1-27c5-4061-9a4d-c7bcade86a05 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:11.708167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfc204-1c2c-44ea-999f-b8467452daa3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3956fc9953b5453cb3bdd22a841b0bdf, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:11.709905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfc204-1c2c-44ea-999f-b8467452daa3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:11.723134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 154/304] 10.222.0.49 () {58 vars in 1334 bytes} [Fri Sep 16 19:13:11 2022] PUT /identity/v3/system/users/3956fc9953b5453cb3bdd22a841b0bdf/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:11.770482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfc204-1c2c-44ea-999f-b8467452daa3 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:11.857753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0bda1-27c5-4061-9a4d-c7bcade86a05 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:11.892090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfc204-1c2c-44ea-999f-b8467452daa3 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:11.903355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395c3e7-cc42-441e-9d07-133e7a6c747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:11.904256 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c3e7-cc42-441e-9d07-133e7a6c747a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:11.905129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c3e7-cc42-441e-9d07-133e7a6c747a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:11.905552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c3e7-cc42-441e-9d07-133e7a6c747a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:11.921156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395c3e7-cc42-441e-9d07-133e7a6c747a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-5395c3e7-cc42-441e-9d07-133e7a6c747a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:11.928178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:11.929326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:11.930289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:11.933144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 151/305] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:11.939733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395c3e7-cc42-441e-9d07-133e7a6c747a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:11.940858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc77b5-976e-4b09-94e2-4cd9d86a14db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:11.941540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc77b5-976e-4b09-94e2-4cd9d86a14db None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:11.941808 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc77b5-976e-4b09-94e2-4cd9d86a14db None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:11.942075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc77b5-976e-4b09-94e2-4cd9d86a14db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:11.944043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc77b5-976e-4b09-94e2-4cd9d86a14db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:11.946544 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc77b5-976e-4b09-94e2-4cd9d86a14db None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:11.947565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 155/306] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:11.953645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc77b5-976e-4b09-94e2-4cd9d86a14db None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:11.960671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:12.010748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:12.066277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc77b5-976e-4b09-94e2-4cd9d86a14db None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:12.068160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395c3e7-cc42-441e-9d07-133e7a6c747a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:12.102767 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2173c0-9306-4783-a741-0aca0861b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:12.103376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2173c0-9306-4783-a741-0aca0861b977 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.103659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2173c0-9306-4783-a741-0aca0861b977 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.103982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2173c0-9306-4783-a741-0aca0861b977 None admin] PATH_INFO: `/v3/groups` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.104657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2173c0-9306-4783-a741-0aca0861b977 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:12.106115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2173c0-9306-4783-a741-0aca0861b977 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:12.108112 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d6df-6d16-40e4-813d-f399198c8b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:12.109109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d6df-6d16-40e4-813d-f399198c8b65 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.109572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d6df-6d16-40e4-813d-f399198c8b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.110055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d6df-6d16-40e4-813d-f399198c8b65 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.110722 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d6df-6d16-40e4-813d-f399198c8b65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:12.111022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d6df-6d16-40e4-813d-f399198c8b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:12.112368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d6df-6d16-40e4-813d-f399198c8b65 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:12.121451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 152/307] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:12.122764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd40c-499d-4cf9-8878-11109b5c90cd None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.123041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd40c-499d-4cf9-8878-11109b5c90cd None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.123311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd40c-499d-4cf9-8878-11109b5c90cd None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.124264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 156/308] 10.222.0.49 () {60 vars in 1134 bytes} [Fri Sep 16 19:13:11 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:13:12.124535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 153/309] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:12.134541 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600334-3ccd-42f0-ad8a-bd33a05e213c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.134909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600334-3ccd-42f0-ad8a-bd33a05e213c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.135082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600334-3ccd-42f0-ad8a-bd33a05e213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.138481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2173c0-9306-4783-a741-0aca0861b977 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:12.164129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-b0600334-3ccd-42f0-ad8a-bd33a05e213c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:12.166823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b0600334-3ccd-42f0-ad8a-bd33a05e213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:12.254501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2173c0-9306-4783-a741-0aca0861b977 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:12.267187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:12.279942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 154/310] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:12.299042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0837b9-512a-4496-82e1-c6cc9848e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:12.300008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0837b9-512a-4496-82e1-c6cc9848e56a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.300552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0837b9-512a-4496-82e1-c6cc9848e56a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.300993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0837b9-512a-4496-82e1-c6cc9848e56a None admin] PATH_INFO: `/v3/users/ef1346d2894347d2857d05521c4c28db` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.316596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0837b9-512a-4496-82e1-c6cc9848e56a None admin] RBAC: Authorizing `identity:get_user(user_id=ef1346d2894347d2857d05521c4c28db)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:12.318862 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0837b9-512a-4496-82e1-c6cc9848e56a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:12.321525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 157/311] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:12 2022] GET /identity/v3/users/ef1346d2894347d2857d05521c4c28db => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:12.327453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0600334-3ccd-42f0-ad8a-bd33a05e213c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:12.337219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:12.434447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0600334-3ccd-42f0-ad8a-bd33a05e213c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:12.470311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cdd55-569d-4d15-842b-bcd1137549e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:12.470934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cdd55-569d-4d15-842b-bcd1137549e8 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.471213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cdd55-569d-4d15-842b-bcd1137549e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.471486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cdd55-569d-4d15-842b-bcd1137549e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.472228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cdd55-569d-4d15-842b-bcd1137549e8 None admin] RBAC: Adding query filter params (role.id=908a16375c894bac957d576ea917ac03, user.id=ef1346d2894347d2857d05521c4c28db, scope.system=all) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:12.472571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cdd55-569d-4d15-842b-bcd1137549e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:12.474056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cdd55-569d-4d15-842b-bcd1137549e8 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:12.479741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 155/312] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Sep 16 19:13:12 2022] GET /identity/v3/role_assignments?user.id=ef1346d2894347d2857d05521c4c28db&scope.system=all&role.id=908a16375c894bac957d576ea917ac03 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:12.585052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0837b9-512a-4496-82e1-c6cc9848e56a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:12.701634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0837b9-512a-4496-82e1-c6cc9848e56a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:12.737494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fe0d8-e21b-4fc7-91fb-8e1389604b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:12.738146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fe0d8-e21b-4fc7-91fb-8e1389604b9d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.738430 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fe0d8-e21b-4fc7-91fb-8e1389604b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.738756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fe0d8-e21b-4fc7-91fb-8e1389604b9d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.749843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fe0d8-e21b-4fc7-91fb-8e1389604b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-c16fe0d8-e21b-4fc7-91fb-8e1389604b9d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:12.755565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:12.756742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:12.757543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 158/313] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:12.772080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cdd55-569d-4d15-842b-bcd1137549e8 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:12.848037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:12.880159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cdd55-569d-4d15-842b-bcd1137549e8 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:12.915470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e07a4-b3b8-4094-a102-bd12a91cc1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:12.916135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e07a4-b3b8-4094-a102-bd12a91cc1bf None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.916442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e07a4-b3b8-4094-a102-bd12a91cc1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.916769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e07a4-b3b8-4094-a102-bd12a91cc1bf None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.917448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e07a4-b3b8-4094-a102-bd12a91cc1bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:12.917755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e07a4-b3b8-4094-a102-bd12a91cc1bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:12.919153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e07a4-b3b8-4094-a102-bd12a91cc1bf None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:12.927937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 156/314] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:12.937575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fe0d8-e21b-4fc7-91fb-8e1389604b9d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:12.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:13.066382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fe0d8-e21b-4fc7-91fb-8e1389604b9d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:13.103321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce644-26b1-4928-adda-b8667c1bac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:13.103972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce644-26b1-4928-adda-b8667c1bac9b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:13.104253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce644-26b1-4928-adda-b8667c1bac9b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:13.104559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce644-26b1-4928-adda-b8667c1bac9b None admin] PATH_INFO: `/v3/users/25816b990e9b4eacb50d06c7edd06754` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:13.105707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce644-26b1-4928-adda-b8667c1bac9b None admin] RBAC: Authorizing `identity:get_user(user_id=25816b990e9b4eacb50d06c7edd06754)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:13.107192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce644-26b1-4928-adda-b8667c1bac9b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:13.109223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 159/315] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:12 2022] GET /identity/v3/users/25816b990e9b4eacb50d06c7edd06754 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:13.117598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e07a4-b3b8-4094-a102-bd12a91cc1bf None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:13.218790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e07a4-b3b8-4094-a102-bd12a91cc1bf None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:13.247998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:13.253546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bcecd-fee9-4310-84a0-8f4c7d415405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:13.254556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bcecd-fee9-4310-84a0-8f4c7d415405 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:13.255085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bcecd-fee9-4310-84a0-8f4c7d415405 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:13.255650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bcecd-fee9-4310-84a0-8f4c7d415405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:13.327553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bcecd-fee9-4310-84a0-8f4c7d415405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:13.329058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bcecd-fee9-4310-84a0-8f4c7d415405 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:13.432168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 157/316] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:13.438126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce644-26b1-4928-adda-b8667c1bac9b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:13.544112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:13.550370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce644-26b1-4928-adda-b8667c1bac9b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:13.585457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da050b68-c962-4ed9-92ec-dcc34b9bff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:13.586105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da050b68-c962-4ed9-92ec-dcc34b9bff1f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:13.586383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da050b68-c962-4ed9-92ec-dcc34b9bff1f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:13.586656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da050b68-c962-4ed9-92ec-dcc34b9bff1f None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:13.587785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da050b68-c962-4ed9-92ec-dcc34b9bff1f None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:13.589338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da050b68-c962-4ed9-92ec-dcc34b9bff1f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:13.591013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 160/317] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:13 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:13.597124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bcecd-fee9-4310-84a0-8f4c7d415405 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:13.628818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:13.697769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bcecd-fee9-4310-84a0-8f4c7d415405 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:13.732360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce2385-2145-4cba-a7a1-252c3ffe80b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:13.733361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce2385-2145-4cba-a7a1-252c3ffe80b5 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:13.733851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce2385-2145-4cba-a7a1-252c3ffe80b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:13.734317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce2385-2145-4cba-a7a1-252c3ffe80b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:13.735234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce2385-2145-4cba-a7a1-252c3ffe80b5 None admin] RBAC: Adding query filter params (role.id=908a16375c894bac957d576ea917ac03, scope.project.id=07bd28977c0c409484da39a0d92ca5cf, user.id=25816b990e9b4eacb50d06c7edd06754) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:13.735735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce2385-2145-4cba-a7a1-252c3ffe80b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:13.737493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce2385-2145-4cba-a7a1-252c3ffe80b5 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:13.744172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 158/318] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:13 2022] GET /identity/v3/role_assignments?user.id=25816b990e9b4eacb50d06c7edd06754&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=908a16375c894bac957d576ea917ac03 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:13.990667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c02e4-2666-4d1d-bc13-769159ca7d20 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:13.990965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c02e4-2666-4d1d-bc13-769159ca7d20 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:13.991154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c02e4-2666-4d1d-bc13-769159ca7d20 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:13.992556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 161/319] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:13.997994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19067cbc-14b5-4cc5-b9ea-dbb5fdaf4d73 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:13.998280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19067cbc-14b5-4cc5-b9ea-dbb5fdaf4d73 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:13.998553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19067cbc-14b5-4cc5-b9ea-dbb5fdaf4d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:14.017952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-19067cbc-14b5-4cc5-b9ea-dbb5fdaf4d73 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:14.019138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-19067cbc-14b5-4cc5-b9ea-dbb5fdaf4d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:14.090492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 159/320] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:14.365455 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c02e4-2666-4d1d-bc13-769159ca7d20 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:14.454642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8020f-0966-41bc-83ab-57b723bc1299 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:14.455190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8020f-0966-41bc-83ab-57b723bc1299 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:14.455190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8020f-0966-41bc-83ab-57b723bc1299 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:14.456538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 160/321] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:13:14.461715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc38db-bbfe-4c36-83ef-8be029d6351b None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:14.462179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc38db-bbfe-4c36-83ef-8be029d6351b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:14.462619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc38db-bbfe-4c36-83ef-8be029d6351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:14.477089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c02e4-2666-4d1d-bc13-769159ca7d20 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:14.480720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-42fc38db-bbfe-4c36-83ef-8be029d6351b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:14.481905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-42fc38db-bbfe-4c36-83ef-8be029d6351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:14.503197 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:14.513015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d103cc-bda1-46df-b072-add0983d590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:14.513692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d103cc-bda1-46df-b072-add0983d590e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:14.513931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d103cc-bda1-46df-b072-add0983d590e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:14.514197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d103cc-bda1-46df-b072-add0983d590e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:14.525114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d103cc-bda1-46df-b072-add0983d590e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-55d103cc-bda1-46df-b072-add0983d590e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:14.530000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:14.531079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:14.531982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 162/322] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:14.537340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d103cc-bda1-46df-b072-add0983d590e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:14.555799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 161/323] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:14.564666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:14.640962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d103cc-bda1-46df-b072-add0983d590e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:14.677884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706fb18-4fed-45c5-8d01-9bad79a74fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:14.678521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706fb18-4fed-45c5-8d01-9bad79a74fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:14.678791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706fb18-4fed-45c5-8d01-9bad79a74fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:14.679053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706fb18-4fed-45c5-8d01-9bad79a74fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:14.679739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706fb18-4fed-45c5-8d01-9bad79a74fd5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:14.680038 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706fb18-4fed-45c5-8d01-9bad79a74fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:14.681495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706fb18-4fed-45c5-8d01-9bad79a74fd5 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:14.696810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 163/324] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:14.698269 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc38db-bbfe-4c36-83ef-8be029d6351b None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:14.793359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688d1b-0629-4176-b6aa-b69844e47ff0 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:14.793675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688d1b-0629-4176-b6aa-b69844e47ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:14.793902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688d1b-0629-4176-b6aa-b69844e47ff0 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:14.795382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 164/325] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:13:14.800117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1947d-e74d-4bfb-af4b-d647d79f2a61 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:14.800377 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1947d-e74d-4bfb-af4b-d647d79f2a61 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:14.800681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1947d-e74d-4bfb-af4b-d647d79f2a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:14.814044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc38db-bbfe-4c36-83ef-8be029d6351b None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:14.819413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-67f1947d-e74d-4bfb-af4b-d647d79f2a61 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:14.820828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-67f1947d-e74d-4bfb-af4b-d647d79f2a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:14.849835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be54ace-7938-4161-a576-f7092d5a2f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:14.850480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be54ace-7938-4161-a576-f7092d5a2f20 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:14.850775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be54ace-7938-4161-a576-f7092d5a2f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:14.851029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be54ace-7938-4161-a576-f7092d5a2f20 None admin] PATH_INFO: `/v3/users/3956fc9953b5453cb3bdd22a841b0bdf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:14.852173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be54ace-7938-4161-a576-f7092d5a2f20 None admin] RBAC: Authorizing `identity:get_user(user_id=3956fc9953b5453cb3bdd22a841b0bdf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:14.853681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be54ace-7938-4161-a576-f7092d5a2f20 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:14.855277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 162/326] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:14 2022] GET /identity/v3/users/3956fc9953b5453cb3bdd22a841b0bdf => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:14.856033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be54ace-7938-4161-a576-f7092d5a2f20 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:14.880992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:14.890591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 165/327] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:14.891635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1947d-e74d-4bfb-af4b-d647d79f2a61 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:14.909542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:14.962150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be54ace-7938-4161-a576-f7092d5a2f20 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:14.997476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef7529-8146-4f0d-bd05-854f0678ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:14.998106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef7529-8146-4f0d-bd05-854f0678ba92 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:14.998384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef7529-8146-4f0d-bd05-854f0678ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:14.998718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef7529-8146-4f0d-bd05-854f0678ba92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:14.999736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef7529-8146-4f0d-bd05-854f0678ba92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:15.001188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef7529-8146-4f0d-bd05-854f0678ba92 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:15.002758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 163/328] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:15.004147 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1947d-e74d-4bfb-af4b-d647d79f2a61 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:15.008359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef7529-8146-4f0d-bd05-854f0678ba92 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:15.042711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaea942-2a48-47b7-845a-4a0c9510a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:15.043577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaea942-2a48-47b7-845a-4a0c9510a47a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:15.043861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaea942-2a48-47b7-845a-4a0c9510a47a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:15.044134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaea942-2a48-47b7-845a-4a0c9510a47a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:15.044901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaea942-2a48-47b7-845a-4a0c9510a47a None admin] RBAC: Adding query filter params (role.id=4debeb1d97ca4a77afef4ab92d134846, user.id=3956fc9953b5453cb3bdd22a841b0bdf, scope.system=all) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:15.045239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaea942-2a48-47b7-845a-4a0c9510a47a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:15.046696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaea942-2a48-47b7-845a-4a0c9510a47a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:15.058724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 166/329] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Sep 16 19:13:14 2022] GET /identity/v3/role_assignments?user.id=3956fc9953b5453cb3bdd22a841b0bdf&scope.system=all&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:15.122327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:15.133531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef7529-8146-4f0d-bd05-854f0678ba92 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:15.158581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaea942-2a48-47b7-845a-4a0c9510a47a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:15.171602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b315d7-a6ad-4a09-80ff-5e0b44f5cdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:15.172227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b315d7-a6ad-4a09-80ff-5e0b44f5cdb0 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:15.172535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b315d7-a6ad-4a09-80ff-5e0b44f5cdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:15.172811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b315d7-a6ad-4a09-80ff-5e0b44f5cdb0 None admin] PATH_INFO: `/v3/groups` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:15.173457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b315d7-a6ad-4a09-80ff-5e0b44f5cdb0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:15.174906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b315d7-a6ad-4a09-80ff-5e0b44f5cdb0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:15.195455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 164/330] 10.222.0.49 () {60 vars in 1134 bytes} [Fri Sep 16 19:13:15 2022] POST /identity/v3/groups => generated 226 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:13:15.259562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:15.287803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaea942-2a48-47b7-845a-4a0c9510a47a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:15.330950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106458b-0322-4d2f-914e-aa009da75802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:15.331623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106458b-0322-4d2f-914e-aa009da75802 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:15.331900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106458b-0322-4d2f-914e-aa009da75802 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:15.332173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106458b-0322-4d2f-914e-aa009da75802 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:15.344599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106458b-0322-4d2f-914e-aa009da75802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-2106458b-0322-4d2f-914e-aa009da75802 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:15.351050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:15.352064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:15.352936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:15.356581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 167/331] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:15.358327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b315d7-a6ad-4a09-80ff-5e0b44f5cdb0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:15.463009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b315d7-a6ad-4a09-80ff-5e0b44f5cdb0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:15.497510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9857-fe3b-431c-8d05-a7a34db188ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:15.498127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9857-fe3b-431c-8d05-a7a34db188ae None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:15.498406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9857-fe3b-431c-8d05-a7a34db188ae None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:15.498676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9857-fe3b-431c-8d05-a7a34db188ae None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:15.499352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba9857-fe3b-431c-8d05-a7a34db188ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:15.499655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba9857-fe3b-431c-8d05-a7a34db188ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:15.501073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba9857-fe3b-431c-8d05-a7a34db188ae None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:15.509815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 165/332] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:15.515391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106458b-0322-4d2f-914e-aa009da75802 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:15.622902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106458b-0322-4d2f-914e-aa009da75802 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:15.662720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f5efc-e0c1-4de4-bd8d-a1aea3423143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:15.663378 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5efc-e0c1-4de4-bd8d-a1aea3423143 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:15.663651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5efc-e0c1-4de4-bd8d-a1aea3423143 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:15.663916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5efc-e0c1-4de4-bd8d-a1aea3423143 None admin] PATH_INFO: `/v3/users/ef1346d2894347d2857d05521c4c28db` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:15.665093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f5efc-e0c1-4de4-bd8d-a1aea3423143 None admin] RBAC: Authorizing `identity:get_user(user_id=ef1346d2894347d2857d05521c4c28db)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:15.666584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f5efc-e0c1-4de4-bd8d-a1aea3423143 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:15.668181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 168/333] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:15 2022] GET /identity/v3/users/ef1346d2894347d2857d05521c4c28db => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:15.673890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9857-fe3b-431c-8d05-a7a34db188ae None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:15.693279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:15.793097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9857-fe3b-431c-8d05-a7a34db188ae None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:15.835768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5a96e-6cb3-41fd-8fe0-e9e0bc8ada04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:15.836812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5a96e-6cb3-41fd-8fe0-e9e0bc8ada04 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:15.837282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5a96e-6cb3-41fd-8fe0-e9e0bc8ada04 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:15.837739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5a96e-6cb3-41fd-8fe0-e9e0bc8ada04 None admin] PATH_INFO: `/v3/system/users/ef1346d2894347d2857d05521c4c28db/roles/908a16375c894bac957d576ea917ac03` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:15.839433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5a96e-6cb3-41fd-8fe0-e9e0bc8ada04 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef1346d2894347d2857d05521c4c28db, role_id=908a16375c894bac957d576ea917ac03)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:15.841127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5a96e-6cb3-41fd-8fe0-e9e0bc8ada04 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:15.859223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 166/334] 10.222.0.49 () {58 vars in 1334 bytes} [Fri Sep 16 19:13:15 2022] PUT /identity/v3/system/users/ef1346d2894347d2857d05521c4c28db/roles/908a16375c894bac957d576ea917ac03 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:17.791781 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ed92-91b7-4a76-891b-b92e3ebf418a None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:17.792799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ed92-91b7-4a76-891b-b92e3ebf418a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:17.793275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ed92-91b7-4a76-891b-b92e3ebf418a None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:17.795147 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 169/335] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:17.800268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d4676-74f3-45d2-8083-d272d8d9c782 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:17.800774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d4676-74f3-45d2-8083-d272d8d9c782 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:17.800865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d4676-74f3-45d2-8083-d272d8d9c782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:17.829900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e89d4676-74f3-45d2-8083-d272d8d9c782 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:17.831099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e89d4676-74f3-45d2-8083-d272d8d9c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:17.850892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52f2ec-ef54-4ab0-a0fc-9337aaa3d2ba None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:17.851621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52f2ec-ef54-4ab0-a0fc-9337aaa3d2ba None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:17.852157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52f2ec-ef54-4ab0-a0fc-9337aaa3d2ba None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:17.855661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 170/336] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:17.860422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd8b8e-5466-437a-9fc5-a777a6d78717 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:17.861142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd8b8e-5466-437a-9fc5-a777a6d78717 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:17.862364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd8b8e-5466-437a-9fc5-a777a6d78717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:17.879327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:17.909405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8dbd8b8e-5466-437a-9fc5-a777a6d78717 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:17.911312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8dbd8b8e-5466-437a-9fc5-a777a6d78717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:17.959477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 167/337] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:18.019616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 171/338] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:18.408458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75203a-41d5-446c-8654-070c967e4717 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:18.409129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75203a-41d5-446c-8654-070c967e4717 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:18.409607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75203a-41d5-446c-8654-070c967e4717 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:18.411596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 168/339] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:18.416881 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f462c4-5577-473b-95fc-80d71f4556f5 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:18.417412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f462c4-5577-473b-95fc-80d71f4556f5 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:18.417988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f462c4-5577-473b-95fc-80d71f4556f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:18.440187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-a3f462c4-5577-473b-95fc-80d71f4556f5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:18.441670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a3f462c4-5577-473b-95fc-80d71f4556f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:18.486785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75203a-41d5-446c-8654-070c967e4717 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:18.500293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:18.530685 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 172/340] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:18.547755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f462c4-5577-473b-95fc-80d71f4556f5 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:18.682428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:18.693792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75203a-41d5-446c-8654-070c967e4717 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:18.755754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f462c4-5577-473b-95fc-80d71f4556f5 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:18.773063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714d321-428d-45f6-b396-d14f13c1d392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:18.773714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d321-428d-45f6-b396-d14f13c1d392 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:18.773990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d321-428d-45f6-b396-d14f13c1d392 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:18.774259 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d321-428d-45f6-b396-d14f13c1d392 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:18.793477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714d321-428d-45f6-b396-d14f13c1d392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-1714d321-428d-45f6-b396-d14f13c1d392 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:18.798382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:18.799298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:18.800121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 169/341] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:18.805867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714d321-428d-45f6-b396-d14f13c1d392 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:18.829111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecce3d-120e-4a12-9441-df90365ed286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:18.830610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecce3d-120e-4a12-9441-df90365ed286 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:18.831154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecce3d-120e-4a12-9441-df90365ed286 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:18.831632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecce3d-120e-4a12-9441-df90365ed286 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:18.868581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecce3d-120e-4a12-9441-df90365ed286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-40ecce3d-120e-4a12-9441-df90365ed286 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:18.880741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:18.881650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:18.882456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:18.885025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 173/342] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:13:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:18.891181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecce3d-120e-4a12-9441-df90365ed286 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:18.909136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:18.962380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714d321-428d-45f6-b396-d14f13c1d392 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:19.029152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278ade-991f-4fb5-99d3-d24d29676593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:19.029777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278ade-991f-4fb5-99d3-d24d29676593 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.030052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278ade-991f-4fb5-99d3-d24d29676593 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.030320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278ade-991f-4fb5-99d3-d24d29676593 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.031056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4278ade-991f-4fb5-99d3-d24d29676593 None admin] RBAC: Adding query filter params (name=member) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:19.031360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4278ade-991f-4fb5-99d3-d24d29676593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:19.032770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4278ade-991f-4fb5-99d3-d24d29676593 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:19.046490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 170/343] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:19.053672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278ade-991f-4fb5-99d3-d24d29676593 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:19.088053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecce3d-120e-4a12-9441-df90365ed286 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:19.132037 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:19.160680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd63d-8cc7-4c54-8b73-45882e05c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:19.161979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd63d-8cc7-4c54-8b73-45882e05c1ff None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.162266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd63d-8cc7-4c54-8b73-45882e05c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.162541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd63d-8cc7-4c54-8b73-45882e05c1ff None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.163231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfd63d-8cc7-4c54-8b73-45882e05c1ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:19.163535 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfd63d-8cc7-4c54-8b73-45882e05c1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:19.164971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfd63d-8cc7-4c54-8b73-45882e05c1ff None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:19.190937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 174/344] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:19.191808 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd63d-8cc7-4c54-8b73-45882e05c1ff None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:19.248354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278ade-991f-4fb5-99d3-d24d29676593 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:19.297728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:19.305646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca58dc-3160-44cc-88d5-70060d1a6d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:19.306609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca58dc-3160-44cc-88d5-70060d1a6d57 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.307083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca58dc-3160-44cc-88d5-70060d1a6d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.307552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca58dc-3160-44cc-88d5-70060d1a6d57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.404083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca58dc-3160-44cc-88d5-70060d1a6d57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:19.406675 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca58dc-3160-44cc-88d5-70060d1a6d57 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:19.413544 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd63d-8cc7-4c54-8b73-45882e05c1ff None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:19.481813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaef9e-6670-406c-9ee3-d531e3e652b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:19.482561 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaef9e-6670-406c-9ee3-d531e3e652b7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.482840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaef9e-6670-406c-9ee3-d531e3e652b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.483109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaef9e-6670-406c-9ee3-d531e3e652b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.495557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaef9e-6670-406c-9ee3-d531e3e652b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-cfbaef9e-6670-406c-9ee3-d531e3e652b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:19.501232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:19.502202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:19.502997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 175/345] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:19.503667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaef9e-6670-406c-9ee3-d531e3e652b7 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:19.535506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 171/346] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:19.537259 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca58dc-3160-44cc-88d5-70060d1a6d57 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:19.565426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:19.577494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:19.639819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaef9e-6670-406c-9ee3-d531e3e652b7 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:19.669855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca58dc-3160-44cc-88d5-70060d1a6d57 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:19.677864 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f827d0f-c1a3-4a49-aa9b-1622e2a88b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:19.678480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f827d0f-c1a3-4a49-aa9b-1622e2a88b57 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.678767 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f827d0f-c1a3-4a49-aa9b-1622e2a88b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.679031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f827d0f-c1a3-4a49-aa9b-1622e2a88b57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.713203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9758d2-edfb-4e39-86b8-6c34507afb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:19.714301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9758d2-edfb-4e39-86b8-6c34507afb81 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.714816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9758d2-edfb-4e39-86b8-6c34507afb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.715278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9758d2-edfb-4e39-86b8-6c34507afb81 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.716202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9758d2-edfb-4e39-86b8-6c34507afb81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:19.716537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9758d2-edfb-4e39-86b8-6c34507afb81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:19.718147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9758d2-edfb-4e39-86b8-6c34507afb81 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:19.731604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 172/347] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:19.732539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9758d2-edfb-4e39-86b8-6c34507afb81 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:19.762626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f827d0f-c1a3-4a49-aa9b-1622e2a88b57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:19.764046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f827d0f-c1a3-4a49-aa9b-1622e2a88b57 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:19.822663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:19.858612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:19.870227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9758d2-edfb-4e39-86b8-6c34507afb81 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:19.887132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 176/348] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:19.888544 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15259a11-01c0-4c0f-9dbe-d32fe588cdfa None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.888839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15259a11-01c0-4c0f-9dbe-d32fe588cdfa None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.889080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15259a11-01c0-4c0f-9dbe-d32fe588cdfa None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.890322 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 177/349] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:19.895729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cbc24-0a27-4e42-b32d-35427901e70b None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.896017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cbc24-0a27-4e42-b32d-35427901e70b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.896288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cbc24-0a27-4e42-b32d-35427901e70b None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.898356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 178/350] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:19.899204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cbc24-0a27-4e42-b32d-35427901e70b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:19.916052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ba598-5869-49ea-a9cf-9129d19e8f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:19.916767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ba598-5869-49ea-a9cf-9129d19e8f2b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.917023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ba598-5869-49ea-a9cf-9129d19e8f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.917291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ba598-5869-49ea-a9cf-9129d19e8f2b None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.918427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ba598-5869-49ea-a9cf-9129d19e8f2b None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:19.919869 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ba598-5869-49ea-a9cf-9129d19e8f2b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:19.922075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 173/351] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:19 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:19.923353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a83e5-ecde-4bae-9428-aa5827571788 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.923353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a83e5-ecde-4bae-9428-aa5827571788 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.923353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a83e5-ecde-4bae-9428-aa5827571788 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.924643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 174/352] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:19.926653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a83e5-ecde-4bae-9428-aa5827571788 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:20.015722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cbc24-0a27-4e42-b32d-35427901e70b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:20.041280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a83e5-ecde-4bae-9428-aa5827571788 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:20.054247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff66df-4af4-4202-ac58-0f7493e44ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:20.054872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff66df-4af4-4202-ac58-0f7493e44ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.055151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff66df-4af4-4202-ac58-0f7493e44ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.055419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff66df-4af4-4202-ac58-0f7493e44ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.073083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:20.082011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3e5e5-c105-41d1-8d7c-6fafa060abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:20.082674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3e5e5-c105-41d1-8d7c-6fafa060abbc None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.083016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3e5e5-c105-41d1-8d7c-6fafa060abbc None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.083443 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3e5e5-c105-41d1-8d7c-6fafa060abbc None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.084808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3e5e5-c105-41d1-8d7c-6fafa060abbc None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:20.086248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3e5e5-c105-41d1-8d7c-6fafa060abbc None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:20.088051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 175/353] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:19 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:20.090169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c3ce-6834-4b05-ad13-51c5e1c56dc5 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.090450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c3ce-6834-4b05-ad13-51c5e1c56dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.090802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c3ce-6834-4b05-ad13-51c5e1c56dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.112515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-53e3c3ce-6834-4b05-ad13-51c5e1c56dc5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:20.113729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-53e3c3ce-6834-4b05-ad13-51c5e1c56dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:20.140325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff66df-4af4-4202-ac58-0f7493e44ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:20.142088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff66df-4af4-4202-ac58-0f7493e44ee8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:20.142263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:20.202502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 176/354] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:20.203775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feb868-dc23-4572-8621-741dd2b22c40 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.204054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feb868-dc23-4572-8621-741dd2b22c40 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.204449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feb868-dc23-4572-8621-741dd2b22c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.225274 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-95feb868-dc23-4572-8621-741dd2b22c40 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:20.226452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-95feb868-dc23-4572-8621-741dd2b22c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:20.264847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 179/355] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:20.266146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff66df-4af4-4202-ac58-0f7493e44ee8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:20.318310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:20.319493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 177/356] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:20.321499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb252bb-eb3b-4edb-a543-99c7e6d30672 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.321825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb252bb-eb3b-4edb-a543-99c7e6d30672 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.322135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb252bb-eb3b-4edb-a543-99c7e6d30672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.340622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-5bb252bb-eb3b-4edb-a543-99c7e6d30672 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:20.342269 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5bb252bb-eb3b-4edb-a543-99c7e6d30672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:20.391625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff66df-4af4-4202-ac58-0f7493e44ee8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:20.415022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 178/357] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:20.415952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb252bb-eb3b-4edb-a543-99c7e6d30672 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:20.435228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477396-6cb4-4038-8c7b-03b72e5d95f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:20.436513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477396-6cb4-4038-8c7b-03b72e5d95f7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.437009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477396-6cb4-4038-8c7b-03b72e5d95f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.437463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477396-6cb4-4038-8c7b-03b72e5d95f7 None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.445451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75477396-6cb4-4038-8c7b-03b72e5d95f7 None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:20.448020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75477396-6cb4-4038-8c7b-03b72e5d95f7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:20.448760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:20.451363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 180/358] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:20 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:20.452509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477396-6cb4-4038-8c7b-03b72e5d95f7 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:20.545161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb252bb-eb3b-4edb-a543-99c7e6d30672 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:20.584328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5434f-2e5a-4cef-95b1-588731c2f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:20.585018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5434f-2e5a-4cef-95b1-588731c2f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.585297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5434f-2e5a-4cef-95b1-588731c2f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.585568 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5434f-2e5a-4cef-95b1-588731c2f3d2 None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.586686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5434f-2e5a-4cef-95b1-588731c2f3d2 None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:20.588150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5434f-2e5a-4cef-95b1-588731c2f3d2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:20.589780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 179/359] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:20 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:20.590556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5434f-2e5a-4cef-95b1-588731c2f3d2 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:20.605009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477396-6cb4-4038-8c7b-03b72e5d95f7 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:20.616045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:20.653029 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e5a5d-8f47-4936-b239-bb922921d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:20.653681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e5a5d-8f47-4936-b239-bb922921d130 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.653964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e5a5d-8f47-4936-b239-bb922921d130 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.654241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e5a5d-8f47-4936-b239-bb922921d130 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.655389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e5a5d-8f47-4936-b239-bb922921d130 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:20.657738 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e5a5d-8f47-4936-b239-bb922921d130 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:20.664065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 181/360] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:20 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:20.664065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e5a5d-8f47-4936-b239-bb922921d130 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:20.696235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:20.721573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5434f-2e5a-4cef-95b1-588731c2f3d2 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:20.767560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69da58f-8315-44cb-b264-0096f2c91358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:20.768436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da58f-8315-44cb-b264-0096f2c91358 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.768551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da58f-8315-44cb-b264-0096f2c91358 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.768749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da58f-8315-44cb-b264-0096f2c91358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.769514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69da58f-8315-44cb-b264-0096f2c91358 None admin] RBAC: Adding query filter params (group.id=08efc3a25df248a69ded736feb53ead7, role.id=4debeb1d97ca4a77afef4ab92d134846, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:20.769815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69da58f-8315-44cb-b264-0096f2c91358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:20.771434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69da58f-8315-44cb-b264-0096f2c91358 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:20.778367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 180/361] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Sep 16 19:13:20 2022] GET /identity/v3/role_assignments?group.id=08efc3a25df248a69ded736feb53ead7&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:20.779218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69da58f-8315-44cb-b264-0096f2c91358 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:20.786080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e5a5d-8f47-4936-b239-bb922921d130 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:20.833440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc75577-0653-4a56-a9a5-896c62a8b3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:20.834048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc75577-0653-4a56-a9a5-896c62a8b3df None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.834331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc75577-0653-4a56-a9a5-896c62a8b3df None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.834611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc75577-0653-4a56-a9a5-896c62a8b3df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.848945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc75577-0653-4a56-a9a5-896c62a8b3df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-5dc75577-0653-4a56-a9a5-896c62a8b3df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:20.854523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:20.855570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:20.856359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 182/362] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:20.857059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc75577-0653-4a56-a9a5-896c62a8b3df None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:20.915620 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:20.931331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69da58f-8315-44cb-b264-0096f2c91358 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:20.979064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054119e-2718-4de5-9bb3-e80422e3ce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:20.979682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054119e-2718-4de5-9bb3-e80422e3ce0e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:20.980010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054119e-2718-4de5-9bb3-e80422e3ce0e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:20.980216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054119e-2718-4de5-9bb3-e80422e3ce0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:20.980983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054119e-2718-4de5-9bb3-e80422e3ce0e None admin] RBAC: Adding query filter params (group.id=08efc3a25df248a69ded736feb53ead7, role.id=e157fabaf96640bf8a975076a70c720d, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:20.981288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054119e-2718-4de5-9bb3-e80422e3ce0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:20.982730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054119e-2718-4de5-9bb3-e80422e3ce0e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:20.989501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 181/363] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Sep 16 19:13:20 2022] GET /identity/v3/role_assignments?group.id=08efc3a25df248a69ded736feb53ead7&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=e157fabaf96640bf8a975076a70c720d => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:20.990350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054119e-2718-4de5-9bb3-e80422e3ce0e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:21.006967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc75577-0653-4a56-a9a5-896c62a8b3df None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:21.009534 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:21.063310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86ee0-63bd-4dd3-94eb-a06d3730eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:21.064082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86ee0-63bd-4dd3-94eb-a06d3730eec9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:21.064445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86ee0-63bd-4dd3-94eb-a06d3730eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:21.064762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86ee0-63bd-4dd3-94eb-a06d3730eec9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:21.078054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d86ee0-63bd-4dd3-94eb-a06d3730eec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-80d86ee0-63bd-4dd3-94eb-a06d3730eec9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:21.083556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:21.084546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:21.085346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 183/364] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:13:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:21.086018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86ee0-63bd-4dd3-94eb-a06d3730eec9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:21.117874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054119e-2718-4de5-9bb3-e80422e3ce0e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:21.163562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18474515-5fb1-4dc6-a004-6af5e65394cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:21.164440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18474515-5fb1-4dc6-a004-6af5e65394cb None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:21.164705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18474515-5fb1-4dc6-a004-6af5e65394cb None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:21.165345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18474515-5fb1-4dc6-a004-6af5e65394cb None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:21.166784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18474515-5fb1-4dc6-a004-6af5e65394cb None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:21.168419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18474515-5fb1-4dc6-a004-6af5e65394cb None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:21.170101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 182/365] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:20 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:21.171545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18474515-5fb1-4dc6-a004-6af5e65394cb None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:21.218168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:21.227072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86ee0-63bd-4dd3-94eb-a06d3730eec9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:21.263275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c66aa-1c45-48b8-afcc-0963bb7bc08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:21.263914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c66aa-1c45-48b8-afcc-0963bb7bc08f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:21.264185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c66aa-1c45-48b8-afcc-0963bb7bc08f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:21.264553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c66aa-1c45-48b8-afcc-0963bb7bc08f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:21.275492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c66aa-1c45-48b8-afcc-0963bb7bc08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-df3c66aa-1c45-48b8-afcc-0963bb7bc08f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:21.280520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:21.281379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:21.282568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 184/366] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:21.283217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c66aa-1c45-48b8-afcc-0963bb7bc08f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:21.290690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:21.310947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18474515-5fb1-4dc6-a004-6af5e65394cb None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:21.352271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ff43d-7eb1-4916-813e-8d2ffc62827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:21.353474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff43d-7eb1-4916-813e-8d2ffc62827b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:21.354115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff43d-7eb1-4916-813e-8d2ffc62827b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:21.354611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff43d-7eb1-4916-813e-8d2ffc62827b None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:21.355493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ff43d-7eb1-4916-813e-8d2ffc62827b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:21.355981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ff43d-7eb1-4916-813e-8d2ffc62827b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:21.357595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ff43d-7eb1-4916-813e-8d2ffc62827b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:21.369183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 183/367] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:21.370500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ff43d-7eb1-4916-813e-8d2ffc62827b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:21.408460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c66aa-1c45-48b8-afcc-0963bb7bc08f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:21.461835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486f1e0-5ab8-4d21-b266-3fa0679504e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:21.462453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486f1e0-5ab8-4d21-b266-3fa0679504e7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:21.464849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486f1e0-5ab8-4d21-b266-3fa0679504e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:21.464849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486f1e0-5ab8-4d21-b266-3fa0679504e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:21.464849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486f1e0-5ab8-4d21-b266-3fa0679504e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:21.464849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486f1e0-5ab8-4d21-b266-3fa0679504e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:21.465322 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486f1e0-5ab8-4d21-b266-3fa0679504e7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:21.476100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 185/368] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:21.476740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486f1e0-5ab8-4d21-b266-3fa0679504e7 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:21.503859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:21.513093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ff43d-7eb1-4916-813e-8d2ffc62827b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:21.571356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc986a9e-4f27-4685-9e2f-6801476b8952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:21.572408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc986a9e-4f27-4685-9e2f-6801476b8952 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:21.572948 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc986a9e-4f27-4685-9e2f-6801476b8952 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:21.573406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc986a9e-4f27-4685-9e2f-6801476b8952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:21.574917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc986a9e-4f27-4685-9e2f-6801476b8952 None admin] RBAC: Adding query filter params (group.id=08efc3a25df248a69ded736feb53ead7, role.id=4debeb1d97ca4a77afef4ab92d134846, scope.project.id=07bd28977c0c409484da39a0d92ca5cf) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:21.575683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc986a9e-4f27-4685-9e2f-6801476b8952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:21.579210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc986a9e-4f27-4685-9e2f-6801476b8952 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:21.586862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 184/369] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Sep 16 19:13:21 2022] GET /identity/v3/role_assignments?group.id=08efc3a25df248a69ded736feb53ead7&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:21.588043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc986a9e-4f27-4685-9e2f-6801476b8952 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:21.655506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486f1e0-5ab8-4d21-b266-3fa0679504e7 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:21.656177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:21.728953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc986a9e-4f27-4685-9e2f-6801476b8952 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:21.741409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533569-99a4-43a1-bb5e-d9fd646f4853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:21.742048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533569-99a4-43a1-bb5e-d9fd646f4853 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:21.742320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533569-99a4-43a1-bb5e-d9fd646f4853 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:21.742589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533569-99a4-43a1-bb5e-d9fd646f4853 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:21.743346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a533569-99a4-43a1-bb5e-d9fd646f4853 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:21.743651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a533569-99a4-43a1-bb5e-d9fd646f4853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:21.745140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a533569-99a4-43a1-bb5e-d9fd646f4853 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:21.760358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 186/370] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:21.761747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533569-99a4-43a1-bb5e-d9fd646f4853 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:21.779656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26a51a-69ec-48aa-b71a-f8b804be5b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:21.780347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a51a-69ec-48aa-b71a-f8b804be5b38 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:21.780639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a51a-69ec-48aa-b71a-f8b804be5b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:21.780969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a51a-69ec-48aa-b71a-f8b804be5b38 None admin] PATH_INFO: `/v3/users/ef1346d2894347d2857d05521c4c28db` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:21.783001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26a51a-69ec-48aa-b71a-f8b804be5b38 None admin] RBAC: Authorizing `identity:get_user(user_id=ef1346d2894347d2857d05521c4c28db)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:21.784597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26a51a-69ec-48aa-b71a-f8b804be5b38 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:21.789827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 185/371] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:13:21 2022] GET /identity/v3/users/ef1346d2894347d2857d05521c4c28db => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:21.790963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26a51a-69ec-48aa-b71a-f8b804be5b38 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:21.914417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:21.940791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:21.948444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26a51a-69ec-48aa-b71a-f8b804be5b38 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:21.960301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533569-99a4-43a1-bb5e-d9fd646f4853 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:22.016243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368ec7d-c89b-4c62-a6c8-0e1684e758f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:22.016978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368ec7d-c89b-4c62-a6c8-0e1684e758f6 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:22.017248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368ec7d-c89b-4c62-a6c8-0e1684e758f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:22.017515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368ec7d-c89b-4c62-a6c8-0e1684e758f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:22.029679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f534d-1ea8-4d0b-be3c-9ea54145b367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:22.030287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f534d-1ea8-4d0b-be3c-9ea54145b367 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:22.030563 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f534d-1ea8-4d0b-be3c-9ea54145b367 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:22.030828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f534d-1ea8-4d0b-be3c-9ea54145b367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:22.123358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368ec7d-c89b-4c62-a6c8-0e1684e758f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:22.125043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368ec7d-c89b-4c62-a6c8-0e1684e758f6 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:22.133986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f534d-1ea8-4d0b-be3c-9ea54145b367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:22.135453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f534d-1ea8-4d0b-be3c-9ea54145b367 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:22.228964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:22.241985 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 187/372] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:22.247239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f534d-1ea8-4d0b-be3c-9ea54145b367 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:22.304782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:22.350089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 186/373] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:22.350966 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368ec7d-c89b-4c62-a6c8-0e1684e758f6 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:22.439313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f534d-1ea8-4d0b-be3c-9ea54145b367 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:22.506289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6194fe-9cec-4bcc-b339-24e5fd61bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:22.506829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6194fe-9cec-4bcc-b339-24e5fd61bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:22.507108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6194fe-9cec-4bcc-b339-24e5fd61bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:22.507382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6194fe-9cec-4bcc-b339-24e5fd61bbd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:22.508118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6194fe-9cec-4bcc-b339-24e5fd61bbd8 None admin] RBAC: Adding query filter params (role.id=908a16375c894bac957d576ea917ac03, user.id=ef1346d2894347d2857d05521c4c28db, scope.system=all) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:22.508450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6194fe-9cec-4bcc-b339-24e5fd61bbd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:22.509917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6194fe-9cec-4bcc-b339-24e5fd61bbd8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:22.536462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 188/374] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Sep 16 19:13:22 2022] GET /identity/v3/role_assignments?user.id=ef1346d2894347d2857d05521c4c28db&scope.system=all&role.id=908a16375c894bac957d576ea917ac03 => generated 510 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:22.543516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368ec7d-c89b-4c62-a6c8-0e1684e758f6 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:22.546024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6194fe-9cec-4bcc-b339-24e5fd61bbd8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:22.629910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c1e80-4883-47e1-9075-63719188b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:22.630636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c1e80-4883-47e1-9075-63719188b268 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:22.630849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c1e80-4883-47e1-9075-63719188b268 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:22.631121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c1e80-4883-47e1-9075-63719188b268 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:22.635818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c1e80-4883-47e1-9075-63719188b268 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:22.636749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:22.641601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c1e80-4883-47e1-9075-63719188b268 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:22.646659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 187/375] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:22 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:22.649883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c1e80-4883-47e1-9075-63719188b268 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:22.744849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:22.786843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6194fe-9cec-4bcc-b339-24e5fd61bbd8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:22.854432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c1e80-4883-47e1-9075-63719188b268 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:22.872176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e8d89-5fa3-4924-ae03-71e375c35243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:22.872877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e8d89-5fa3-4924-ae03-71e375c35243 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:22.873152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e8d89-5fa3-4924-ae03-71e375c35243 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:22.873434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e8d89-5fa3-4924-ae03-71e375c35243 None admin] PATH_INFO: `/v3/projects/e5d7d65acd0047cb8a5a68c90b00c1bb` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:22.874740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e8d89-5fa3-4924-ae03-71e375c35243 None admin] RBAC: Authorizing `identity:get_project(project_id=e5d7d65acd0047cb8a5a68c90b00c1bb)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:22.876137 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e8d89-5fa3-4924-ae03-71e375c35243 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:22.879145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 189/376] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:22 2022] GET /identity/v3/projects/e5d7d65acd0047cb8a5a68c90b00c1bb => generated 344 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:22.888785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e8d89-5fa3-4924-ae03-71e375c35243 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:22.893842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4515eb-8132-4d35-acc9-cbb0d1696b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:22.894847 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4515eb-8132-4d35-acc9-cbb0d1696b3d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:22.895380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4515eb-8132-4d35-acc9-cbb0d1696b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:22.895853 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4515eb-8132-4d35-acc9-cbb0d1696b3d None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:22.897521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4515eb-8132-4d35-acc9-cbb0d1696b3d None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:22.899196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4515eb-8132-4d35-acc9-cbb0d1696b3d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:22.901397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 188/377] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:22 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:22.909996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4515eb-8132-4d35-acc9-cbb0d1696b3d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:23.103775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4515eb-8132-4d35-acc9-cbb0d1696b3d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:23.106886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e8d89-5fa3-4924-ae03-71e375c35243 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:23.116759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:23.131004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:23.168345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde561b-a150-4478-9f35-cc4e1ed2049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:23.168996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde561b-a150-4478-9f35-cc4e1ed2049a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:23.169277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde561b-a150-4478-9f35-cc4e1ed2049a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:23.169546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde561b-a150-4478-9f35-cc4e1ed2049a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:23.170280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde561b-a150-4478-9f35-cc4e1ed2049a None admin] RBAC: Adding query filter params (group.id=08efc3a25df248a69ded736feb53ead7, role.id=e157fabaf96640bf8a975076a70c720d, scope.project.id=07bd28977c0c409484da39a0d92ca5cf) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:23.170586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde561b-a150-4478-9f35-cc4e1ed2049a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:23.172028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde561b-a150-4478-9f35-cc4e1ed2049a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:23.172812 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195f48f-d774-4ac6-aae2-464bedef6f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:23.173451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f48f-d774-4ac6-aae2-464bedef6f5f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:23.173724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f48f-d774-4ac6-aae2-464bedef6f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:23.173991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f48f-d774-4ac6-aae2-464bedef6f5f None admin] PATH_INFO: `/v3/groups/8ddd38c03134495e9306020d712ae137` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:23.182821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195f48f-d774-4ac6-aae2-464bedef6f5f None admin] RBAC: Authorizing `identity:get_group(group_id=8ddd38c03134495e9306020d712ae137)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:23.184296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195f48f-d774-4ac6-aae2-464bedef6f5f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:23.186187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 190/378] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:22 2022] GET /identity/v3/groups/8ddd38c03134495e9306020d712ae137 => generated 229 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:23.187629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 189/379] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Sep 16 19:13:22 2022] GET /identity/v3/role_assignments?group.id=08efc3a25df248a69ded736feb53ead7&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=e157fabaf96640bf8a975076a70c720d => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:23.193061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195f48f-d774-4ac6-aae2-464bedef6f5f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:23.320060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195f48f-d774-4ac6-aae2-464bedef6f5f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:23.361177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df5d95-cd67-4481-ba38-c20dbf5a69b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:23.361720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df5d95-cd67-4481-ba38-c20dbf5a69b3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:23.362002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df5d95-cd67-4481-ba38-c20dbf5a69b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:23.362275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df5d95-cd67-4481-ba38-c20dbf5a69b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:23.363009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df5d95-cd67-4481-ba38-c20dbf5a69b3 None admin] RBAC: Adding query filter params (group.id=8ddd38c03134495e9306020d712ae137, role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=e5d7d65acd0047cb8a5a68c90b00c1bb) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:23.363317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df5d95-cd67-4481-ba38-c20dbf5a69b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:23.364870 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df5d95-cd67-4481-ba38-c20dbf5a69b3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:23.371327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 191/380] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Sep 16 19:13:23 2022] GET /identity/v3/role_assignments?group.id=8ddd38c03134495e9306020d712ae137&scope.project.id=e5d7d65acd0047cb8a5a68c90b00c1bb&role.id=71bed99a52684ba990097719b40ef99d => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:23.441441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a3f1-1799-4b33-a07c-2ea4098e0a85 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:23.441801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a3f1-1799-4b33-a07c-2ea4098e0a85 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:23.442091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a3f1-1799-4b33-a07c-2ea4098e0a85 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:23.443812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 190/381] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:23.451320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eff458-4636-4df4-87db-dde3358c401b None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:23.451638 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eff458-4636-4df4-87db-dde3358c401b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:23.451887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eff458-4636-4df4-87db-dde3358c401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:23.478795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-14eff458-4636-4df4-87db-dde3358c401b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:23.480027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-14eff458-4636-4df4-87db-dde3358c401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:23.516352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:23.570294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 192/382] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:23.776469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642737a9-397b-44d3-aa75-06927fa748dc None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:23.777060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642737a9-397b-44d3-aa75-06927fa748dc None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:23.777537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642737a9-397b-44d3-aa75-06927fa748dc None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:23.779121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 191/383] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:23.784741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928cf95-216f-4b7d-b8e0-4b688ae4c033 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:23.785027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928cf95-216f-4b7d-b8e0-4b688ae4c033 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:23.785309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928cf95-216f-4b7d-b8e0-4b688ae4c033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:23.813414 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6928cf95-216f-4b7d-b8e0-4b688ae4c033 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:23.814609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6928cf95-216f-4b7d-b8e0-4b688ae4c033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:23.888722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 193/384] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:23.915190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642737a9-397b-44d3-aa75-06927fa748dc None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:24.049382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642737a9-397b-44d3-aa75-06927fa748dc None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:24.090729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab6ca5-b9af-4f21-ab9d-6a95c3bf398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:24.091365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6ca5-b9af-4f21-ab9d-6a95c3bf398b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.091637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6ca5-b9af-4f21-ab9d-6a95c3bf398b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.091901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6ca5-b9af-4f21-ab9d-6a95c3bf398b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.105965 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab6ca5-b9af-4f21-ab9d-6a95c3bf398b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-e7ab6ca5-b9af-4f21-ab9d-6a95c3bf398b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:24.114109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:24.115024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:24.115815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:24.122767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 192/385] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:24.124238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928cf95-216f-4b7d-b8e0-4b688ae4c033 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:24.225799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:24.232307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928cf95-216f-4b7d-b8e0-4b688ae4c033 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:24.268373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc747042-e4fe-4c91-a86a-30551abd9f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:24.269008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc747042-e4fe-4c91-a86a-30551abd9f52 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.269281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc747042-e4fe-4c91-a86a-30551abd9f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.269550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc747042-e4fe-4c91-a86a-30551abd9f52 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.270250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc747042-e4fe-4c91-a86a-30551abd9f52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:24.270591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc747042-e4fe-4c91-a86a-30551abd9f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:24.271968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc747042-e4fe-4c91-a86a-30551abd9f52 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:24.280641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 194/386] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:24.286715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab6ca5-b9af-4f21-ab9d-6a95c3bf398b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:24.298856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc747042-e4fe-4c91-a86a-30551abd9f52 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:24.364880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:24.442372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc747042-e4fe-4c91-a86a-30551abd9f52 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:24.488410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4798cf1-4433-489c-88d9-ac0bfc1330ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:24.488410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4798cf1-4433-489c-88d9-ac0bfc1330ca None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.488410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4798cf1-4433-489c-88d9-ac0bfc1330ca None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.488410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4798cf1-4433-489c-88d9-ac0bfc1330ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.497425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4798cf1-4433-489c-88d9-ac0bfc1330ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-a4798cf1-4433-489c-88d9-ac0bfc1330ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:24.504866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:24.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:24.506733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:24.507345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 195/387] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:13:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:24.512417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485a9d-9b75-4802-8712-850e394482c0 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.512825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485a9d-9b75-4802-8712-850e394482c0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.513161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485a9d-9b75-4802-8712-850e394482c0 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.516716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab6ca5-b9af-4f21-ab9d-6a95c3bf398b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:24.518235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 196/388] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:13:24.519024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485a9d-9b75-4802-8712-850e394482c0 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:24.557795 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ade8ca-bf6f-4797-84fb-973671ca179a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:24.558851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade8ca-bf6f-4797-84fb-973671ca179a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.559332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade8ca-bf6f-4797-84fb-973671ca179a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.559995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade8ca-bf6f-4797-84fb-973671ca179a None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.561442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade8ca-bf6f-4797-84fb-973671ca179a None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:24.563188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade8ca-bf6f-4797-84fb-973671ca179a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:24.564759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:24.565357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 193/389] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:24 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:24.566879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8a67-18ce-45d2-bb33-7367d4e35784 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.567397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8a67-18ce-45d2-bb33-7367d4e35784 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.567857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8a67-18ce-45d2-bb33-7367d4e35784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.589719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-c0ff8a67-18ce-45d2-bb33-7367d4e35784 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:24.591257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c0ff8a67-18ce-45d2-bb33-7367d4e35784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:24.662949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485a9d-9b75-4802-8712-850e394482c0 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:24.663291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 194/390] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:24.664374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff8a67-18ce-45d2-bb33-7367d4e35784 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:24.719908 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:24.728613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d5ada-53dd-408a-9b7c-f8a06c7d7e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:24.729225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d5ada-53dd-408a-9b7c-f8a06c7d7e28 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.729498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d5ada-53dd-408a-9b7c-f8a06c7d7e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.729766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d5ada-53dd-408a-9b7c-f8a06c7d7e28 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.730428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d5ada-53dd-408a-9b7c-f8a06c7d7e28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:24.730728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d5ada-53dd-408a-9b7c-f8a06c7d7e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:24.732107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d5ada-53dd-408a-9b7c-f8a06c7d7e28 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:24.746498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 197/391] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:24.751428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d5ada-53dd-408a-9b7c-f8a06c7d7e28 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:24.840537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff8a67-18ce-45d2-bb33-7367d4e35784 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:24.889568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:24.901142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920d7a-eadc-4742-8107-32134acc0363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:24.901788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920d7a-eadc-4742-8107-32134acc0363 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.902066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920d7a-eadc-4742-8107-32134acc0363 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.902333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920d7a-eadc-4742-8107-32134acc0363 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.904264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9920d7a-eadc-4742-8107-32134acc0363 None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:24.905735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9920d7a-eadc-4742-8107-32134acc0363 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:24.908563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 195/392] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:24 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:24.917417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920d7a-eadc-4742-8107-32134acc0363 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:24.927657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d5ada-53dd-408a-9b7c-f8a06c7d7e28 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:24.990198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf418ffc-a860-4c78-9bfe-68f5b68b7941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:24.990854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf418ffc-a860-4c78-9bfe-68f5b68b7941 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.991130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf418ffc-a860-4c78-9bfe-68f5b68b7941 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.991402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf418ffc-a860-4c78-9bfe-68f5b68b7941 None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.992883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf418ffc-a860-4c78-9bfe-68f5b68b7941 None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:24.994335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf418ffc-a860-4c78-9bfe-68f5b68b7941 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:24.996140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 198/393] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:24 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:25.009413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf418ffc-a860-4c78-9bfe-68f5b68b7941 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:25.062119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920d7a-eadc-4742-8107-32134acc0363 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:25.063970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:25.102812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3381705-e410-4fd3-90fe-034544777e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:25.103899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381705-e410-4fd3-90fe-034544777e67 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:25.104402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381705-e410-4fd3-90fe-034544777e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:25.104881 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381705-e410-4fd3-90fe-034544777e67 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/groups/08efc3a25df248a69ded736feb53ead7/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:25.107407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3381705-e410-4fd3-90fe-034544777e67 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea, group_id=08efc3a25df248a69ded736feb53ead7, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:25.109574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3381705-e410-4fd3-90fe-034544777e67 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:25.122882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf418ffc-a860-4c78-9bfe-68f5b68b7941 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:25.126738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 196/394] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Sep 16 19:13:24 2022] PUT /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/groups/08efc3a25df248a69ded736feb53ead7/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:25.128018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3381705-e410-4fd3-90fe-034544777e67 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:25.172138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0fbed-ff37-476a-8d78-94473697a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:25.173558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0fbed-ff37-476a-8d78-94473697a8fe None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:25.174104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0fbed-ff37-476a-8d78-94473697a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:25.174562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0fbed-ff37-476a-8d78-94473697a8fe None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:25.175979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0fbed-ff37-476a-8d78-94473697a8fe None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:25.178117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0fbed-ff37-476a-8d78-94473697a8fe None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:25.180067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 199/395] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:25 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:25.193442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0fbed-ff37-476a-8d78-94473697a8fe None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:25.229700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:25.254775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3381705-e410-4fd3-90fe-034544777e67 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:25.294059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2d4cb-e2b5-4475-88bb-00f8f1bc3c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:25.294724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2d4cb-e2b5-4475-88bb-00f8f1bc3c09 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:25.295007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2d4cb-e2b5-4475-88bb-00f8f1bc3c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:25.295288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2d4cb-e2b5-4475-88bb-00f8f1bc3c09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2d4cb-e2b5-4475-88bb-00f8f1bc3c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-03e2d4cb-e2b5-4475-88bb-00f8f1bc3c09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:25.312413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:25.313308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:25.314605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 197/396] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:25.324258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2d4cb-e2b5-4475-88bb-00f8f1bc3c09 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:25.381262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:25.409191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0fbed-ff37-476a-8d78-94473697a8fe None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:25.452341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78528a60-a5e8-457f-8417-31030b7ae695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:25.452961 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78528a60-a5e8-457f-8417-31030b7ae695 None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:25.453234 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78528a60-a5e8-457f-8417-31030b7ae695 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:25.453500 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78528a60-a5e8-457f-8417-31030b7ae695 None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/groups/08efc3a25df248a69ded736feb53ead7/roles/e157fabaf96640bf8a975076a70c720d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:25.455723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78528a60-a5e8-457f-8417-31030b7ae695 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea, group_id=08efc3a25df248a69ded736feb53ead7, role_id=e157fabaf96640bf8a975076a70c720d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:25.457199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78528a60-a5e8-457f-8417-31030b7ae695 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:25.477335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 200/397] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Sep 16 19:13:25 2022] PUT /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea/groups/08efc3a25df248a69ded736feb53ead7/roles/e157fabaf96640bf8a975076a70c720d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:25.493029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2d4cb-e2b5-4475-88bb-00f8f1bc3c09 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:25.531714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027edd5-7c17-4964-8419-2db2e59cdf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:25.532341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027edd5-7c17-4964-8419-2db2e59cdf08 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:25.532662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027edd5-7c17-4964-8419-2db2e59cdf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:25.532936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027edd5-7c17-4964-8419-2db2e59cdf08 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:25.533622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027edd5-7c17-4964-8419-2db2e59cdf08 None admin] RBAC: Adding query filter params (name=member) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:25.533926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027edd5-7c17-4964-8419-2db2e59cdf08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:25.535340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027edd5-7c17-4964-8419-2db2e59cdf08 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:25.545345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 198/398] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:25.551474 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78528a60-a5e8-457f-8417-31030b7ae695 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:25.638312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:25.677176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78528a60-a5e8-457f-8417-31030b7ae695 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:25.716299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77df951-a3a7-4f8f-9b70-c62c74cdb49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:25.716898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77df951-a3a7-4f8f-9b70-c62c74cdb49c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:25.717180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77df951-a3a7-4f8f-9b70-c62c74cdb49c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:25.717452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77df951-a3a7-4f8f-9b70-c62c74cdb49c None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:25.718576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77df951-a3a7-4f8f-9b70-c62c74cdb49c None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:25.720043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77df951-a3a7-4f8f-9b70-c62c74cdb49c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:25.721995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 201/399] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:25 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:25.729814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027edd5-7c17-4964-8419-2db2e59cdf08 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:25.893876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:25.919135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027edd5-7c17-4964-8419-2db2e59cdf08 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:25.955749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d760d9-79ce-477a-a463-bc731afebdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:25.956417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d760d9-79ce-477a-a463-bc731afebdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:25.956697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d760d9-79ce-477a-a463-bc731afebdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:25.956974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d760d9-79ce-477a-a463-bc731afebdf2 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:25.958242 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d760d9-79ce-477a-a463-bc731afebdf2 None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:25.959707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d760d9-79ce-477a-a463-bc731afebdf2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:25.961388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 199/400] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:25 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:25.967773 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a4007-b35d-4b89-93bc-c6155550c959 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:25.968022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a4007-b35d-4b89-93bc-c6155550c959 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:25.968258 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a4007-b35d-4b89-93bc-c6155550c959 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:25.969774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 202/401] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:25.970548 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d760d9-79ce-477a-a463-bc731afebdf2 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:25.975636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7b29-551c-44df-9d66-7738398158ae None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:25.975920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7b29-551c-44df-9d66-7738398158ae None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:25.976189 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7b29-551c-44df-9d66-7738398158ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:26.010375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-482f7b29-551c-44df-9d66-7738398158ae None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:26.011581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-482f7b29-551c-44df-9d66-7738398158ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:26.095088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d760d9-79ce-477a-a463-bc731afebdf2 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:26.095479 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 203/402] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:26.097356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276186c8-6ecb-4814-b4ec-dff03604464e None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:26.097844 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276186c8-6ecb-4814-b4ec-dff03604464e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:26.098341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276186c8-6ecb-4814-b4ec-dff03604464e None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:26.104760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 204/403] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:26.113290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f873e8-6b87-4926-9713-44af2c427a05 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:26.113928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f873e8-6b87-4926-9713-44af2c427a05 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:26.114450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f873e8-6b87-4926-9713-44af2c427a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:26.131456 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a90c4d-74dc-435f-a5f4-2b40f7d435e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:26.132131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a90c4d-74dc-435f-a5f4-2b40f7d435e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:26.132436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a90c4d-74dc-435f-a5f4-2b40f7d435e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:26.132709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a90c4d-74dc-435f-a5f4-2b40f7d435e3 None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf/groups/08efc3a25df248a69ded736feb53ead7/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:26.134630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a90c4d-74dc-435f-a5f4-2b40f7d435e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=07bd28977c0c409484da39a0d92ca5cf, group_id=08efc3a25df248a69ded736feb53ead7, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:26.140404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a90c4d-74dc-435f-a5f4-2b40f7d435e3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:26.147119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-34f873e8-6b87-4926-9713-44af2c427a05 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:26.148649 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-34f873e8-6b87-4926-9713-44af2c427a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:26.169715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 200/404] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Sep 16 19:13:25 2022] PUT /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf/groups/08efc3a25df248a69ded736feb53ead7/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:26.256903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 205/405] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:26.489214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a90c4d-74dc-435f-a5f4-2b40f7d435e3 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:26.505994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:26.561306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f873e8-6b87-4926-9713-44af2c427a05 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:26.563933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:26.658568 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a90c4d-74dc-435f-a5f4-2b40f7d435e3 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:26.699321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8aa63-c2b3-4cf8-af15-684912e03247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:26.699321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8aa63-c2b3-4cf8-af15-684912e03247 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:26.699321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8aa63-c2b3-4cf8-af15-684912e03247 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:26.699321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8aa63-c2b3-4cf8-af15-684912e03247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:26.708678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8aa63-c2b3-4cf8-af15-684912e03247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-adb8aa63-c2b3-4cf8-af15-684912e03247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:26.716727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:26.717611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:26.718448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 201/406] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:13:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:26.720832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8aa63-c2b3-4cf8-af15-684912e03247 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:26.763525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f873e8-6b87-4926-9713-44af2c427a05 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:26.832971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447e29-2368-445f-a66f-c04c76a90660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:26.833529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447e29-2368-445f-a66f-c04c76a90660 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:26.833803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447e29-2368-445f-a66f-c04c76a90660 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:26.834069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447e29-2368-445f-a66f-c04c76a90660 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:26.855138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63447e29-2368-445f-a66f-c04c76a90660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-63447e29-2368-445f-a66f-c04c76a90660 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:26.860583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:26.861456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:26.862227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:26.862815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:26.862884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 206/407] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:13:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:26.868250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447e29-2368-445f-a66f-c04c76a90660 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:26.908720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8aa63-c2b3-4cf8-af15-684912e03247 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:26.970049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24331f7a-960c-45cb-b238-60778d09be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:26.970921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24331f7a-960c-45cb-b238-60778d09be38 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:26.971336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24331f7a-960c-45cb-b238-60778d09be38 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:26.972500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24331f7a-960c-45cb-b238-60778d09be38 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:26.973431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24331f7a-960c-45cb-b238-60778d09be38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:26.974551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24331f7a-960c-45cb-b238-60778d09be38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:26.976228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24331f7a-960c-45cb-b238-60778d09be38 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:26.987646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:26.993442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 202/408] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:26.998789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24331f7a-960c-45cb-b238-60778d09be38 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:27.048320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447e29-2368-445f-a66f-c04c76a90660 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:27.093310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c97e6-23c0-4c59-9ad5-077d785d57ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:27.093846 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c97e6-23c0-4c59-9ad5-077d785d57ec None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:27.094123 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c97e6-23c0-4c59-9ad5-077d785d57ec None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:27.094393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c97e6-23c0-4c59-9ad5-077d785d57ec None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:27.095067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c97e6-23c0-4c59-9ad5-077d785d57ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:27.095370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c97e6-23c0-4c59-9ad5-077d785d57ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:27.096782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c97e6-23c0-4c59-9ad5-077d785d57ec None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:27.114476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 207/409] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:27.119936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c97e6-23c0-4c59-9ad5-077d785d57ec None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:27.189537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24331f7a-960c-45cb-b238-60778d09be38 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:27.252422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698cdb2-d884-44da-8e80-00f018564550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:27.252422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698cdb2-d884-44da-8e80-00f018564550 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:27.252422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698cdb2-d884-44da-8e80-00f018564550 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:27.252422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698cdb2-d884-44da-8e80-00f018564550 None admin] PATH_INFO: `/v3/groups/8ddd38c03134495e9306020d712ae137` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:27.252868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698cdb2-d884-44da-8e80-00f018564550 None admin] RBAC: Authorizing `identity:get_group(group_id=8ddd38c03134495e9306020d712ae137)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:27.252868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698cdb2-d884-44da-8e80-00f018564550 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:27.254901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 203/410] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:26 2022] GET /identity/v3/groups/8ddd38c03134495e9306020d712ae137 => generated 229 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:27.264088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698cdb2-d884-44da-8e80-00f018564550 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:27.272332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:27.298675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c97e6-23c0-4c59-9ad5-077d785d57ec None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:27.347552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:27.370964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e51e-7a45-488d-a856-1949dac1b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:27.371617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e51e-7a45-488d-a856-1949dac1b3bc None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:27.371896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e51e-7a45-488d-a856-1949dac1b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:27.372174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e51e-7a45-488d-a856-1949dac1b3bc None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:27.373422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26e51e-7a45-488d-a856-1949dac1b3bc None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:27.376042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26e51e-7a45-488d-a856-1949dac1b3bc None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:27.384327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 208/411] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:27 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:27.386794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e51e-7a45-488d-a856-1949dac1b3bc None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:27.490594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698cdb2-d884-44da-8e80-00f018564550 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:27.502863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e51e-7a45-488d-a856-1949dac1b3bc None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:27.539299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d6091-6bc8-4fa1-97aa-48d1c3b5266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:27.540295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6091-6bc8-4fa1-97aa-48d1c3b5266f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:27.540796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6091-6bc8-4fa1-97aa-48d1c3b5266f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:27.541248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6091-6bc8-4fa1-97aa-48d1c3b5266f None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:27.542580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d6091-6bc8-4fa1-97aa-48d1c3b5266f None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:27.544302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d6091-6bc8-4fa1-97aa-48d1c3b5266f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:27.546442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 209/412] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:27 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:27.552403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d6091-6bc8-4fa1-97aa-48d1c3b5266f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:27.577573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72238e-b7d6-4395-8825-3e09b25781f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:27.578557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72238e-b7d6-4395-8825-3e09b25781f0 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:27.579050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72238e-b7d6-4395-8825-3e09b25781f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:27.579493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72238e-b7d6-4395-8825-3e09b25781f0 None admin] PATH_INFO: `/v3/projects/e5d7d65acd0047cb8a5a68c90b00c1bb` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:27.581511 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72238e-b7d6-4395-8825-3e09b25781f0 None admin] RBAC: Authorizing `identity:get_project(project_id=e5d7d65acd0047cb8a5a68c90b00c1bb)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:27.584223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72238e-b7d6-4395-8825-3e09b25781f0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:27.589094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 204/413] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:27 2022] GET /identity/v3/projects/e5d7d65acd0047cb8a5a68c90b00c1bb => generated 344 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:27.594427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72238e-b7d6-4395-8825-3e09b25781f0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:27.667439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:27.728613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:27.747150 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d6091-6bc8-4fa1-97aa-48d1c3b5266f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:27.790520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72238e-b7d6-4395-8825-3e09b25781f0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:27.812750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bbbfc-5c3c-463f-995c-3743680180de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:27.813475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bbbfc-5c3c-463f-995c-3743680180de None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:27.813758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bbbfc-5c3c-463f-995c-3743680180de None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:27.814033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bbbfc-5c3c-463f-995c-3743680180de None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf/groups/08efc3a25df248a69ded736feb53ead7/roles/e157fabaf96640bf8a975076a70c720d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:27.818047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bbbfc-5c3c-463f-995c-3743680180de None admin] RBAC: Authorizing `identity:create_grant(project_id=07bd28977c0c409484da39a0d92ca5cf, group_id=08efc3a25df248a69ded736feb53ead7, role_id=e157fabaf96640bf8a975076a70c720d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:27.819589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bbbfc-5c3c-463f-995c-3743680180de None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:27.844816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 210/414] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Sep 16 19:13:27 2022] PUT /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf/groups/08efc3a25df248a69ded736feb53ead7/roles/e157fabaf96640bf8a975076a70c720d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:13:27.857383 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec321d7-8c3c-4284-86f9-be58b83eda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:27.858235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec321d7-8c3c-4284-86f9-be58b83eda53 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:27.858522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec321d7-8c3c-4284-86f9-be58b83eda53 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:27.858916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec321d7-8c3c-4284-86f9-be58b83eda53 None admin] PATH_INFO: `/v3/projects/e5d7d65acd0047cb8a5a68c90b00c1bb/groups/8ddd38c03134495e9306020d712ae137/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:27.862208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec321d7-8c3c-4284-86f9-be58b83eda53 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5d7d65acd0047cb8a5a68c90b00c1bb, group_id=8ddd38c03134495e9306020d712ae137, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:27.863876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec321d7-8c3c-4284-86f9-be58b83eda53 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:27.898745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 205/415] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Sep 16 19:13:27 2022] PUT /identity/v3/projects/e5d7d65acd0047cb8a5a68c90b00c1bb/groups/8ddd38c03134495e9306020d712ae137/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:13:28.023799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d8b56-4f28-4360-ad17-c6119f625be5 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:28.024148 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d8b56-4f28-4360-ad17-c6119f625be5 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:28.024367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d8b56-4f28-4360-ad17-c6119f625be5 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:28.025871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 211/416] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:28.031846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767da092-3598-421b-959b-3a33464b8915 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:28.032176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767da092-3598-421b-959b-3a33464b8915 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:28.032421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767da092-3598-421b-959b-3a33464b8915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:28.045773 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f8c6a-4721-47f8-a780-5cdee72a1a9a None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:28.046423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f8c6a-4721-47f8-a780-5cdee72a1a9a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:28.046893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f8c6a-4721-47f8-a780-5cdee72a1a9a None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:28.048795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 212/417] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:28.055105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56763cd2-af33-4ded-9006-87b4551164a4 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:28.055721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56763cd2-af33-4ded-9006-87b4551164a4 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:28.056221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56763cd2-af33-4ded-9006-87b4551164a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:28.060743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-767da092-3598-421b-959b-3a33464b8915 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:28.062081 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-767da092-3598-421b-959b-3a33464b8915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:28.077557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-56763cd2-af33-4ded-9006-87b4551164a4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:28.079127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-56763cd2-af33-4ded-9006-87b4551164a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:28.144322 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 206/418] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:28.158174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 213/419] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:28.417519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767da092-3598-421b-959b-3a33464b8915 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:28.455897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56763cd2-af33-4ded-9006-87b4551164a4 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:28.481033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:28.532410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767da092-3598-421b-959b-3a33464b8915 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:28.542940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:28.570988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196da32-bb92-43c2-af1f-e511e930141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:28.571637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196da32-bb92-43c2-af1f-e511e930141d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:28.571915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196da32-bb92-43c2-af1f-e511e930141d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:28.572186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196da32-bb92-43c2-af1f-e511e930141d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:28.598527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196da32-bb92-43c2-af1f-e511e930141d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-5196da32-bb92-43c2-af1f-e511e930141d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:28.603512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:28.604363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:28.605206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:28.609251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 207/420] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:13:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:28.618211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196da32-bb92-43c2-af1f-e511e930141d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:28.658513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56763cd2-af33-4ded-9006-87b4551164a4 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:28.761413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196da32-bb92-43c2-af1f-e511e930141d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:28.769101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cd701-508d-44ab-a374-678d08f1cf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:28.770058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cd701-508d-44ab-a374-678d08f1cf30 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:28.770058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cd701-508d-44ab-a374-678d08f1cf30 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:28.770321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cd701-508d-44ab-a374-678d08f1cf30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:28.784247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:28.801445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cd701-508d-44ab-a374-678d08f1cf30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:28.801617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f901ba6-51a5-47f6-a940-f5f3e236a49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:28.802100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f901ba6-51a5-47f6-a940-f5f3e236a49b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:28.802372 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f901ba6-51a5-47f6-a940-f5f3e236a49b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:28.802639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f901ba6-51a5-47f6-a940-f5f3e236a49b None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:28.803307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f901ba6-51a5-47f6-a940-f5f3e236a49b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:28.803607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f901ba6-51a5-47f6-a940-f5f3e236a49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:28.805008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f901ba6-51a5-47f6-a940-f5f3e236a49b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-9c1cd701-508d-44ab-a374-678d08f1cf30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:28.806702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:28.807566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:28.808361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:28.813943 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 214/421] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:28.815472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e97e50-299e-401d-87b3-345b786a1a1a None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:28.815965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e97e50-299e-401d-87b3-345b786a1a1a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:28.816469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e97e50-299e-401d-87b3-345b786a1a1a None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:28.818064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 215/422] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:28.821321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 208/423] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:28.822354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e97e50-299e-401d-87b3-345b786a1a1a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:28.826649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf12194-4e03-47e5-947c-105c101ad062 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:28.827003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf12194-4e03-47e5-947c-105c101ad062 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:28.827286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf12194-4e03-47e5-947c-105c101ad062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:28.846736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-5bf12194-4e03-47e5-947c-105c101ad062 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:28.848311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5bf12194-4e03-47e5-947c-105c101ad062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:28.923724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 209/424] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:28.924342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf12194-4e03-47e5-947c-105c101ad062 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:28.973395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e97e50-299e-401d-87b3-345b786a1a1a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:28.988828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:29.020911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ff1d2-39a4-4624-abf3-553849cc01b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:29.021928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ff1d2-39a4-4624-abf3-553849cc01b5 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:29.022913 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ff1d2-39a4-4624-abf3-553849cc01b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:29.023378 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ff1d2-39a4-4624-abf3-553849cc01b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:29.024233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ff1d2-39a4-4624-abf3-553849cc01b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:29.024748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ff1d2-39a4-4624-abf3-553849cc01b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:29.026337 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ff1d2-39a4-4624-abf3-553849cc01b5 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:29.041027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 216/425] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:29.043103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ff1d2-39a4-4624-abf3-553849cc01b5 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:29.156299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf12194-4e03-47e5-947c-105c101ad062 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:29.182036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:29.220755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41458f6e-4f63-4769-9b54-b30cf8367999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:29.221364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41458f6e-4f63-4769-9b54-b30cf8367999 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:29.221638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41458f6e-4f63-4769-9b54-b30cf8367999 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:29.221911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41458f6e-4f63-4769-9b54-b30cf8367999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:29.228949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ff1d2-39a4-4624-abf3-553849cc01b5 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:29.284574 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbaa93-f08d-4abf-ba6c-00a7c2622f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:29.285096 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbaa93-f08d-4abf-ba6c-00a7c2622f4d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:29.285516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbaa93-f08d-4abf-ba6c-00a7c2622f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:29.285793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbaa93-f08d-4abf-ba6c-00a7c2622f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:29.331830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:29.344257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41458f6e-4f63-4769-9b54-b30cf8367999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:29.347308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41458f6e-4f63-4769-9b54-b30cf8367999 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:29.365549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbaa93-f08d-4abf-ba6c-00a7c2622f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:29.367324 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbaa93-f08d-4abf-ba6c-00a7c2622f4d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:29.465479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 210/426] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:29.466252 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41458f6e-4f63-4769-9b54-b30cf8367999 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:29.481515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:29.495017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 217/427] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:29.496624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbaa93-f08d-4abf-ba6c-00a7c2622f4d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:29.568042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:29.571331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41458f6e-4f63-4769-9b54-b30cf8367999 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:29.599665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbaa93-f08d-4abf-ba6c-00a7c2622f4d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:29.606740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d10fe1-d13b-40f9-b80b-0b03946f1c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:29.607384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d10fe1-d13b-40f9-b80b-0b03946f1c37 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:29.607662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d10fe1-d13b-40f9-b80b-0b03946f1c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:29.607933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d10fe1-d13b-40f9-b80b-0b03946f1c37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:29.618538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d10fe1-d13b-40f9-b80b-0b03946f1c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-46d10fe1-d13b-40f9-b80b-0b03946f1c37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:29.623376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:29.624244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:13:29.625100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:29.629667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 211/428] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:29.630357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d10fe1-d13b-40f9-b80b-0b03946f1c37 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:29.640158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e07497-4e04-4c01-acc0-73340d4304ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:29.641067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e07497-4e04-4c01-acc0-73340d4304ef None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:29.641568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e07497-4e04-4c01-acc0-73340d4304ef None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:29.642024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e07497-4e04-4c01-acc0-73340d4304ef None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:29.643326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e07497-4e04-4c01-acc0-73340d4304ef None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:29.645125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e07497-4e04-4c01-acc0-73340d4304ef None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:29.647253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 218/429] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:29 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:29.648266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e07497-4e04-4c01-acc0-73340d4304ef None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:29.702987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:29.735403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d10fe1-d13b-40f9-b80b-0b03946f1c37 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:29.751461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e07497-4e04-4c01-acc0-73340d4304ef None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:29.771450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79dc71-28b1-4a22-a2f0-f515920e296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:29.772111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79dc71-28b1-4a22-a2f0-f515920e296e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:29.772559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79dc71-28b1-4a22-a2f0-f515920e296e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:29.772661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79dc71-28b1-4a22-a2f0-f515920e296e None admin] PATH_INFO: `/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:29.773813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79dc71-28b1-4a22-a2f0-f515920e296e None admin] RBAC: Authorizing `identity:get_project(project_id=7a47bbefd31a4d8ba175d6d1cb8c52ea)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:29.775272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79dc71-28b1-4a22-a2f0-f515920e296e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:29.781525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 212/430] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:29 2022] GET /identity/v3/projects/7a47bbefd31a4d8ba175d6d1cb8c52ea => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:29.781525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79dc71-28b1-4a22-a2f0-f515920e296e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:29.794890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686af78-e667-4503-b6b0-29b182ba1407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:29.795706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686af78-e667-4503-b6b0-29b182ba1407 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:29.796140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686af78-e667-4503-b6b0-29b182ba1407 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:29.796576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686af78-e667-4503-b6b0-29b182ba1407 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:29.797371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686af78-e667-4503-b6b0-29b182ba1407 None admin] RBAC: Adding query filter params (name=member) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:29.797841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686af78-e667-4503-b6b0-29b182ba1407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:29.799391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686af78-e667-4503-b6b0-29b182ba1407 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:29.808928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 219/431] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:13:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:29.810069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686af78-e667-4503-b6b0-29b182ba1407 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:29.828819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:29.908630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79dc71-28b1-4a22-a2f0-f515920e296e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:29.921085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686af78-e667-4503-b6b0-29b182ba1407 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:29.946669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2983c-81ee-4a9b-9e7f-f2b156949eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:29.947469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2983c-81ee-4a9b-9e7f-f2b156949eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:29.947763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2983c-81ee-4a9b-9e7f-f2b156949eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:29.948038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2983c-81ee-4a9b-9e7f-f2b156949eb7 None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:29.949559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2983c-81ee-4a9b-9e7f-f2b156949eb7 None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:29.951254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2983c-81ee-4a9b-9e7f-f2b156949eb7 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:29.953222 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 213/432] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:29 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:29.954116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2983c-81ee-4a9b-9e7f-f2b156949eb7 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:29.961141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1135ef-de6b-4eb7-ada4-96d3bc2b9858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:29.962055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1135ef-de6b-4eb7-ada4-96d3bc2b9858 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:29.962541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1135ef-de6b-4eb7-ada4-96d3bc2b9858 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:29.962995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1135ef-de6b-4eb7-ada4-96d3bc2b9858 None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:29.964417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1135ef-de6b-4eb7-ada4-96d3bc2b9858 None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:29.966232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:29.966914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1135ef-de6b-4eb7-ada4-96d3bc2b9858 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:29.968898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 220/433] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:29 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:29.974990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1135ef-de6b-4eb7-ada4-96d3bc2b9858 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:30.051405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:30.068560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2983c-81ee-4a9b-9e7f-f2b156949eb7 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:30.087908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1135ef-de6b-4eb7-ada4-96d3bc2b9858 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:30.108355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77d77e-4d4d-419e-aac2-df88712a48dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:30.109003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77d77e-4d4d-419e-aac2-df88712a48dd None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.109283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77d77e-4d4d-419e-aac2-df88712a48dd None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.109557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77d77e-4d4d-419e-aac2-df88712a48dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.126367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f4af0-57d5-491b-9da5-e9a19cad4d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:30.127395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f4af0-57d5-491b-9da5-e9a19cad4d51 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.127889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f4af0-57d5-491b-9da5-e9a19cad4d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.128344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f4af0-57d5-491b-9da5-e9a19cad4d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.129610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f4af0-57d5-491b-9da5-e9a19cad4d51 None admin] RBAC: Adding query filter params (group.id=08efc3a25df248a69ded736feb53ead7, role.id=e157fabaf96640bf8a975076a70c720d, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:30.130156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f4af0-57d5-491b-9da5-e9a19cad4d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:30.131832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f4af0-57d5-491b-9da5-e9a19cad4d51 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:30.138790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 221/434] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Sep 16 19:13:29 2022] GET /identity/v3/role_assignments?group.id=08efc3a25df248a69ded736feb53ead7&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=e157fabaf96640bf8a975076a70c720d => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:30.140086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f4af0-57d5-491b-9da5-e9a19cad4d51 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:30.185028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77d77e-4d4d-419e-aac2-df88712a48dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:30.186514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77d77e-4d4d-419e-aac2-df88712a48dd None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:30.198965 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:30.258773 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f4af0-57d5-491b-9da5-e9a19cad4d51 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:30.296009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da2c27-6265-4a5a-a464-0e4924f263c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:30.296372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2c27-6265-4a5a-a464-0e4924f263c4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.296662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2c27-6265-4a5a-a464-0e4924f263c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.296936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2c27-6265-4a5a-a464-0e4924f263c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.297768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da2c27-6265-4a5a-a464-0e4924f263c4 None admin] RBAC: Adding query filter params (group.id=08efc3a25df248a69ded736feb53ead7, role.id=4debeb1d97ca4a77afef4ab92d134846, scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:30.298077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da2c27-6265-4a5a-a464-0e4924f263c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:30.299605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da2c27-6265-4a5a-a464-0e4924f263c4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:30.302515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:30.317502 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 222/435] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Sep 16 19:13:30 2022] GET /identity/v3/role_assignments?group.id=08efc3a25df248a69ded736feb53ead7&scope.project.id=7a47bbefd31a4d8ba175d6d1cb8c52ea&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:30.326193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 214/436] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:30.333375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da2c27-6265-4a5a-a464-0e4924f263c4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:30.438330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c09192-6071-4bd7-9e10-49dac47de411 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.438512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c09192-6071-4bd7-9e10-49dac47de411 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.438792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c09192-6071-4bd7-9e10-49dac47de411 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.440668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 215/437] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:30.446957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc6779-350f-4096-8759-7438de38c96e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.447317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc6779-350f-4096-8759-7438de38c96e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.447668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc6779-350f-4096-8759-7438de38c96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.471332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-37dc6779-350f-4096-8759-7438de38c96e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:30.472895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-37dc6779-350f-4096-8759-7438de38c96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:30.483915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da2c27-6265-4a5a-a464-0e4924f263c4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:30.529759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86e773-1137-43c6-b9aa-4752fc3debed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:30.530549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86e773-1137-43c6-b9aa-4752fc3debed None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.530670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86e773-1137-43c6-b9aa-4752fc3debed None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.530938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86e773-1137-43c6-b9aa-4752fc3debed None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.532097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86e773-1137-43c6-b9aa-4752fc3debed None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:30.533701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86e773-1137-43c6-b9aa-4752fc3debed None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:30.535718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 223/438] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:30 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:30.537976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f4788-e7d8-474f-b2d8-6f37d39e0e46 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.538256 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f4788-e7d8-474f-b2d8-6f37d39e0e46 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.538527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f4788-e7d8-474f-b2d8-6f37d39e0e46 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.540267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 224/439] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:30.547120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bff8c-dc74-46da-8197-78f9d371318f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.547431 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bff8c-dc74-46da-8197-78f9d371318f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.547867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bff8c-dc74-46da-8197-78f9d371318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.565827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 216/440] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:30.566807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc6779-350f-4096-8759-7438de38c96e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:30.571631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-e79bff8c-dc74-46da-8197-78f9d371318f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:30.573641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e79bff8c-dc74-46da-8197-78f9d371318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:30.616494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:30.653702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:30.662256 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 225/441] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:30.702460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc6779-350f-4096-8759-7438de38c96e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:30.742160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ee43b-193e-446d-b1d5-3d0288b0689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:30.742805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ee43b-193e-446d-b1d5-3d0288b0689c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.743079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ee43b-193e-446d-b1d5-3d0288b0689c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.743352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ee43b-193e-446d-b1d5-3d0288b0689c None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.744491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ee43b-193e-446d-b1d5-3d0288b0689c None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:30.745942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ee43b-193e-446d-b1d5-3d0288b0689c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:30.747624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 217/442] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:30 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:30.756819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bff8c-dc74-46da-8197-78f9d371318f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:30.834780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ee43b-193e-446d-b1d5-3d0288b0689c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:30.870357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bff8c-dc74-46da-8197-78f9d371318f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:30.909283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15856-6522-4933-bd22-b6a8d0cf63c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:30.909902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15856-6522-4933-bd22-b6a8d0cf63c1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.910270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15856-6522-4933-bd22-b6a8d0cf63c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.910705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15856-6522-4933-bd22-b6a8d0cf63c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.911466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc15856-6522-4933-bd22-b6a8d0cf63c1 None admin] RBAC: Adding query filter params (group.id=08efc3a25df248a69ded736feb53ead7, role.id=4debeb1d97ca4a77afef4ab92d134846, scope.project.id=07bd28977c0c409484da39a0d92ca5cf) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:30.911779 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc15856-6522-4933-bd22-b6a8d0cf63c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:30.913253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc15856-6522-4933-bd22-b6a8d0cf63c1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:30.920113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 226/443] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Sep 16 19:13:30 2022] GET /identity/v3/role_assignments?group.id=08efc3a25df248a69ded736feb53ead7&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=4debeb1d97ca4a77afef4ab92d134846 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:30.937979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15856-6522-4933-bd22-b6a8d0cf63c1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:30.968714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ee43b-193e-446d-b1d5-3d0288b0689c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:30.979115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.018281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.025927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a56438-95c5-48dc-993b-cbb9c0e7b3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.026947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a56438-95c5-48dc-993b-cbb9c0e7b3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.027221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a56438-95c5-48dc-993b-cbb9c0e7b3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.027485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a56438-95c5-48dc-993b-cbb9c0e7b3e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.046545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a56438-95c5-48dc-993b-cbb9c0e7b3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-81a56438-95c5-48dc-993b-cbb9c0e7b3e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:31.053153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:31.054142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:31.054953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 218/444] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:13:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:31.060602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a56438-95c5-48dc-993b-cbb9c0e7b3e0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.078319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15856-6522-4933-bd22-b6a8d0cf63c1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:31.124794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe868c4b-9083-4451-a709-06619a3e04e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.125668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe868c4b-9083-4451-a709-06619a3e04e4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.125668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe868c4b-9083-4451-a709-06619a3e04e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.125937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe868c4b-9083-4451-a709-06619a3e04e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.140609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe868c4b-9083-4451-a709-06619a3e04e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-fe868c4b-9083-4451-a709-06619a3e04e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:31.145703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:31.146625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:31.147419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 227/445] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:13:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:31.154609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe868c4b-9083-4451-a709-06619a3e04e4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.203296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a56438-95c5-48dc-993b-cbb9c0e7b3e0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:31.243956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e3e5e-f95b-43c0-b8c7-7d2bf4ab9e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.244645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3e5e-f95b-43c0-b8c7-7d2bf4ab9e2f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.244924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3e5e-f95b-43c0-b8c7-7d2bf4ab9e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.245255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3e5e-f95b-43c0-b8c7-7d2bf4ab9e2f None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.245863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e3e5e-f95b-43c0-b8c7-7d2bf4ab9e2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:31.246163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e3e5e-f95b-43c0-b8c7-7d2bf4ab9e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:31.247692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e3e5e-f95b-43c0-b8c7-7d2bf4ab9e2f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:31.256371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 219/446] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:31.262862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e3e5e-f95b-43c0-b8c7-7d2bf4ab9e2f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.266503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe868c4b-9083-4451-a709-06619a3e04e4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:31.292358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.298887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.311235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97d6ae-fda9-41f8-8ddf-acec565891ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.311858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d6ae-fda9-41f8-8ddf-acec565891ab None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.312136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d6ae-fda9-41f8-8ddf-acec565891ab None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.312426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d6ae-fda9-41f8-8ddf-acec565891ab None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.313119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97d6ae-fda9-41f8-8ddf-acec565891ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:31.313421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97d6ae-fda9-41f8-8ddf-acec565891ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:31.314803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97d6ae-fda9-41f8-8ddf-acec565891ab None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:31.324191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 228/447] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:31.330289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97d6ae-fda9-41f8-8ddf-acec565891ab None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.377354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e3e5e-f95b-43c0-b8c7-7d2bf4ab9e2f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:31.412004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392187d0-b7e5-41cb-a60f-643b0b4a82b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.412639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392187d0-b7e5-41cb-a60f-643b0b4a82b9 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.412912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392187d0-b7e5-41cb-a60f-643b0b4a82b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.413182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392187d0-b7e5-41cb-a60f-643b0b4a82b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.430780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97d6ae-fda9-41f8-8ddf-acec565891ab None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:31.466903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d07f5-890e-4402-a775-dee454ef8573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.467537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d07f5-890e-4402-a775-dee454ef8573 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.467818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d07f5-890e-4402-a775-dee454ef8573 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.468085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d07f5-890e-4402-a775-dee454ef8573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.480897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392187d0-b7e5-41cb-a60f-643b0b4a82b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:31.482354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392187d0-b7e5-41cb-a60f-643b0b4a82b9 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:31.511738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.522694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.541655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d07f5-890e-4402-a775-dee454ef8573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:31.543116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d07f5-890e-4402-a775-dee454ef8573 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:31.584586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 220/448] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:31.590444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392187d0-b7e5-41cb-a60f-643b0b4a82b9 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.641439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 229/449] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:13:31.647178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d07f5-890e-4402-a775-dee454ef8573 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.686265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392187d0-b7e5-41cb-a60f-643b0b4a82b9 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:31.712304 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.721404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222569c-0b38-4cf4-9f86-e6fc63ca84aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.722036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222569c-0b38-4cf4-9f86-e6fc63ca84aa None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.722316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222569c-0b38-4cf4-9f86-e6fc63ca84aa None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.722655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222569c-0b38-4cf4-9f86-e6fc63ca84aa None admin] PATH_INFO: `/v3/projects/07bd28977c0c409484da39a0d92ca5cf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.723791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222569c-0b38-4cf4-9f86-e6fc63ca84aa None admin] RBAC: Authorizing `identity:get_project(project_id=07bd28977c0c409484da39a0d92ca5cf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:31.724782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.725328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222569c-0b38-4cf4-9f86-e6fc63ca84aa None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:31.727124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 221/450] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/projects/07bd28977c0c409484da39a0d92ca5cf => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:31.732681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222569c-0b38-4cf4-9f86-e6fc63ca84aa None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.743622 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d07f5-890e-4402-a775-dee454ef8573 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:31.778156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1c53c-cbd8-4e8e-8ebc-aa55cc83ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.778795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1c53c-cbd8-4e8e-8ebc-aa55cc83ad19 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.779073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1c53c-cbd8-4e8e-8ebc-aa55cc83ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.779340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1c53c-cbd8-4e8e-8ebc-aa55cc83ad19 None admin] PATH_INFO: `/v3/projects/e5d7d65acd0047cb8a5a68c90b00c1bb` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.780476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1c53c-cbd8-4e8e-8ebc-aa55cc83ad19 None admin] RBAC: Authorizing `identity:get_project(project_id=e5d7d65acd0047cb8a5a68c90b00c1bb)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:31.781935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1c53c-cbd8-4e8e-8ebc-aa55cc83ad19 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:31.783562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 230/451] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/projects/e5d7d65acd0047cb8a5a68c90b00c1bb => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:31.789193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1c53c-cbd8-4e8e-8ebc-aa55cc83ad19 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.829678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222569c-0b38-4cf4-9f86-e6fc63ca84aa None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:31.863062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f3b81-6ba5-4b52-8732-1cb5acfda491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.863739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3b81-6ba5-4b52-8732-1cb5acfda491 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.863981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3b81-6ba5-4b52-8732-1cb5acfda491 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.864240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3b81-6ba5-4b52-8732-1cb5acfda491 None admin] PATH_INFO: `/v3/groups/08efc3a25df248a69ded736feb53ead7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.865385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f3b81-6ba5-4b52-8732-1cb5acfda491 None admin] RBAC: Authorizing `identity:get_group(group_id=08efc3a25df248a69ded736feb53ead7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:31.866823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f3b81-6ba5-4b52-8732-1cb5acfda491 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:31.868420 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 222/452] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/groups/08efc3a25df248a69ded736feb53ead7 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:31.874238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f3b81-6ba5-4b52-8732-1cb5acfda491 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.886268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1c53c-cbd8-4e8e-8ebc-aa55cc83ad19 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:31.918992 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a44ac-8974-4bdf-85fe-17989968bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.919617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a44ac-8974-4bdf-85fe-17989968bc93 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.919891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a44ac-8974-4bdf-85fe-17989968bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.920156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a44ac-8974-4bdf-85fe-17989968bc93 None admin] PATH_INFO: `/v3/groups/8ddd38c03134495e9306020d712ae137` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.921293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a44ac-8974-4bdf-85fe-17989968bc93 None admin] RBAC: Authorizing `identity:get_group(group_id=8ddd38c03134495e9306020d712ae137)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:31.922746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a44ac-8974-4bdf-85fe-17989968bc93 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:31.924322 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 231/453] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/groups/8ddd38c03134495e9306020d712ae137 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:31.930595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a44ac-8974-4bdf-85fe-17989968bc93 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.937799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.949863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.975861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f3b81-6ba5-4b52-8732-1cb5acfda491 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:32.009304 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f718916-aba0-42d6-a4f6-d7c0fb12204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:32.009897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f718916-aba0-42d6-a4f6-d7c0fb12204f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:32.010168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f718916-aba0-42d6-a4f6-d7c0fb12204f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:32.010437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f718916-aba0-42d6-a4f6-d7c0fb12204f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:32.011149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f718916-aba0-42d6-a4f6-d7c0fb12204f None admin] RBAC: Adding query filter params (group.id=08efc3a25df248a69ded736feb53ead7, role.id=e157fabaf96640bf8a975076a70c720d, scope.project.id=07bd28977c0c409484da39a0d92ca5cf) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:32.011451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f718916-aba0-42d6-a4f6-d7c0fb12204f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:32.012917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f718916-aba0-42d6-a4f6-d7c0fb12204f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:32.018520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 223/454] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/role_assignments?group.id=08efc3a25df248a69ded736feb53ead7&scope.project.id=07bd28977c0c409484da39a0d92ca5cf&role.id=e157fabaf96640bf8a975076a70c720d => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:32.029033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a44ac-8974-4bdf-85fe-17989968bc93 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:32.070657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397856c-5f53-47b2-a80f-5015ff86fd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:32.071281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397856c-5f53-47b2-a80f-5015ff86fd1e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:32.071541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397856c-5f53-47b2-a80f-5015ff86fd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:32.071807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397856c-5f53-47b2-a80f-5015ff86fd1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:32.072587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397856c-5f53-47b2-a80f-5015ff86fd1e None admin] RBAC: Adding query filter params (group.id=8ddd38c03134495e9306020d712ae137, role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=e5d7d65acd0047cb8a5a68c90b00c1bb) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:32.072895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397856c-5f53-47b2-a80f-5015ff86fd1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:32.074376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397856c-5f53-47b2-a80f-5015ff86fd1e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:32.081364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 232/455] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/role_assignments?group.id=8ddd38c03134495e9306020d712ae137&scope.project.id=e5d7d65acd0047cb8a5a68c90b00c1bb&role.id=71bed99a52684ba990097719b40ef99d => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:34.996162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4eac-f68e-49f3-8cbf-c27ce5dd946d None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:34.997243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4eac-f68e-49f3-8cbf-c27ce5dd946d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:34.997721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4eac-f68e-49f3-8cbf-c27ce5dd946d None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:34.999514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 224/456] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:35.005294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44f799-715e-49e3-b86e-5cb2009031d6 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:35.006133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44f799-715e-49e3-b86e-5cb2009031d6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:35.006607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44f799-715e-49e3-b86e-5cb2009031d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:35.033846 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1d44f799-715e-49e3-b86e-5cb2009031d6 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:35.035381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1d44f799-715e-49e3-b86e-5cb2009031d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:35.130525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 233/457] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:35.201662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c2af-92e5-4a77-9de6-ec8583cebac0 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:35.202295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c2af-92e5-4a77-9de6-ec8583cebac0 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:35.202752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c2af-92e5-4a77-9de6-ec8583cebac0 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:35.204646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 225/458] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:35.210043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9e9e3-6a04-4c05-be52-01141b073228 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:35.210323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9e9e3-6a04-4c05-be52-01141b073228 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:35.210593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9e9e3-6a04-4c05-be52-01141b073228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:35.237341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-b9d9e9e3-6a04-4c05-be52-01141b073228 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:35.238607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b9d9e9e3-6a04-4c05-be52-01141b073228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:35.246312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:35.310211 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 234/459] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:35.322064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f66a0-d044-4aa7-afc9-1f00411f9378 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:35.322342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f66a0-d044-4aa7-afc9-1f00411f9378 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:35.322610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f66a0-d044-4aa7-afc9-1f00411f9378 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:35.324077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 226/460] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:35.329078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa7a7-c3d8-4f1e-a7ab-74582ad8f633 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:35.329358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa7a7-c3d8-4f1e-a7ab-74582ad8f633 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:35.329628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa7a7-c3d8-4f1e-a7ab-74582ad8f633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:35.348021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-78dfa7a7-c3d8-4f1e-a7ab-74582ad8f633 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:35.349348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-78dfa7a7-c3d8-4f1e-a7ab-74582ad8f633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:35.443272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 235/461] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:35.459780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f66a0-d044-4aa7-afc9-1f00411f9378 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:35.588751 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f66a0-d044-4aa7-afc9-1f00411f9378 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:35.615128 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:35.623071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cb84b-682a-4ec3-ab70-1256f2ff2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:35.624194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cb84b-682a-4ec3-ab70-1256f2ff2f49 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:35.624904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cb84b-682a-4ec3-ab70-1256f2ff2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:35.625362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cb84b-682a-4ec3-ab70-1256f2ff2f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:35.636709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cb84b-682a-4ec3-ab70-1256f2ff2f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:35.638369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cb84b-682a-4ec3-ab70-1256f2ff2f49 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:35.639195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfa7a7-c3d8-4f1e-a7ab-74582ad8f633 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-1e7cb84b-682a-4ec3-ab70-1256f2ff2f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:35.653235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:35.654153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:35.654997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:35.654997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:35.654997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:35.654997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 227/462] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:35.664557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cb84b-682a-4ec3-ab70-1256f2ff2f49 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:35.780756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:35.819442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfa7a7-c3d8-4f1e-a7ab-74582ad8f633 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:35.829651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cb84b-682a-4ec3-ab70-1256f2ff2f49 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:35.864223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e6779-dd53-47bd-b397-25f264b6b8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:35.865109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e6779-dd53-47bd-b397-25f264b6b8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:35.865522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e6779-dd53-47bd-b397-25f264b6b8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:35.865926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e6779-dd53-47bd-b397-25f264b6b8f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:35.866698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e6779-dd53-47bd-b397-25f264b6b8f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:35.867134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e6779-dd53-47bd-b397-25f264b6b8f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:35.868685 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e6779-dd53-47bd-b397-25f264b6b8f0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:35.881448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 228/463] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:35.882917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e133d5-ad95-48bf-8aeb-de4e107cb7ea None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:35.883384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e133d5-ad95-48bf-8aeb-de4e107cb7ea None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:35.883788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e133d5-ad95-48bf-8aeb-de4e107cb7ea None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:35.885275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 229/464] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:35.886369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e133d5-ad95-48bf-8aeb-de4e107cb7ea None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:35.886562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18915311-3bc0-44cc-9192-0ba3e9d95752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:35.887276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18915311-3bc0-44cc-9192-0ba3e9d95752 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:35.888553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18915311-3bc0-44cc-9192-0ba3e9d95752 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:35.889001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18915311-3bc0-44cc-9192-0ba3e9d95752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:35.900690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18915311-3bc0-44cc-9192-0ba3e9d95752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:35.902269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18915311-3bc0-44cc-9192-0ba3e9d95752 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-18915311-3bc0-44cc-9192-0ba3e9d95752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:35.917635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:35.918568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:35.919410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:35.919410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:35.919410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:35.919410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 236/465] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:35.919834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18915311-3bc0-44cc-9192-0ba3e9d95752 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:35.938329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:35.999261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e133d5-ad95-48bf-8aeb-de4e107cb7ea None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:36.027326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18915311-3bc0-44cc-9192-0ba3e9d95752 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:36.034253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884c278-b164-4b98-9043-d999cde875f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:36.034923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884c278-b164-4b98-9043-d999cde875f2 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:36.035279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884c278-b164-4b98-9043-d999cde875f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:36.035717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884c278-b164-4b98-9043-d999cde875f2 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:36.036098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884c278-b164-4b98-9043-d999cde875f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:36.037547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884c278-b164-4b98-9043-d999cde875f2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:36.051920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:36.065279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb201-7730-4967-9fa7-96e880862621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:36.065917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb201-7730-4967-9fa7-96e880862621 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:36.066459 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb201-7730-4967-9fa7-96e880862621 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:36.067025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb201-7730-4967-9fa7-96e880862621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:36.068669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 230/466] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:13:35 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:13:36.070634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28cdcb-2d52-4e37-9e0a-8ea7bacf5c4b None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:36.070921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28cdcb-2d52-4e37-9e0a-8ea7bacf5c4b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:36.071193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28cdcb-2d52-4e37-9e0a-8ea7bacf5c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:36.083726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defb201-7730-4967-9fa7-96e880862621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:36.085731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defb201-7730-4967-9fa7-96e880862621 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:36.092923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-be28cdcb-2d52-4e37-9e0a-8ea7bacf5c4b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:36.094161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-be28cdcb-2d52-4e37-9e0a-8ea7bacf5c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-5defb201-7730-4967-9fa7-96e880862621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:36.104951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:36.105917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:36.106818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:36.106818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:36.106818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:36.108880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 237/467] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:36.109997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb201-7730-4967-9fa7-96e880862621 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:36.179592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 231/468] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:36.180944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28cdcb-2d52-4e37-9e0a-8ea7bacf5c4b None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:36.217860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:36.327164 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb201-7730-4967-9fa7-96e880862621 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:36.331897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28cdcb-2d52-4e37-9e0a-8ea7bacf5c4b None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:36.369948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1751c6-d573-4985-98be-35b167fb0fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:36.370564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1751c6-d573-4985-98be-35b167fb0fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:36.370835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1751c6-d573-4985-98be-35b167fb0fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:36.371102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1751c6-d573-4985-98be-35b167fb0fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:36.371747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1751c6-d573-4985-98be-35b167fb0fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:36.372047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1751c6-d573-4985-98be-35b167fb0fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:36.372581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11f716-161e-4a38-aaa6-f191df6b05e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:36.373189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11f716-161e-4a38-aaa6-f191df6b05e6 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:36.373460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1751c6-d573-4985-98be-35b167fb0fb3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:36.373556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11f716-161e-4a38-aaa6-f191df6b05e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:36.373724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11f716-161e-4a38-aaa6-f191df6b05e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:36.374359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11f716-161e-4a38-aaa6-f191df6b05e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:36.374665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11f716-161e-4a38-aaa6-f191df6b05e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:36.376032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11f716-161e-4a38-aaa6-f191df6b05e6 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:36.388095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 238/469] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:36.388647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 232/470] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:36.390138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef713-c2ce-48da-95cd-6293395ac328 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:36.390561 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef713-c2ce-48da-95cd-6293395ac328 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:36.390973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef713-c2ce-48da-95cd-6293395ac328 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:36.392442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 239/471] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:36.398314 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b4d5-1e39-4c7d-bfe5-4343f9cc5e2a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:36.398597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b4d5-1e39-4c7d-bfe5-4343f9cc5e2a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:36.398871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b4d5-1e39-4c7d-bfe5-4343f9cc5e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:36.399129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ef713-c2ce-48da-95cd-6293395ac328 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:36.420688 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f304b4d5-1e39-4c7d-bfe5-4343f9cc5e2a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:36.421880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f304b4d5-1e39-4c7d-bfe5-4343f9cc5e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:36.439631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:36.511674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 233/472] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:36.512938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304b4d5-1e39-4c7d-bfe5-4343f9cc5e2a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:36.515820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ef713-c2ce-48da-95cd-6293395ac328 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:36.532236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:36.556310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee0aa2-d35b-451d-97bd-ed97fb2bf337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:36.556310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee0aa2-d35b-451d-97bd-ed97fb2bf337 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:36.556637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee0aa2-d35b-451d-97bd-ed97fb2bf337 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:36.556853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee0aa2-d35b-451d-97bd-ed97fb2bf337 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:36.557567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee0aa2-d35b-451d-97bd-ed97fb2bf337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:36.559007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee0aa2-d35b-451d-97bd-ed97fb2bf337 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:36.587812 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 240/473] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:13:36 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:13:36.588682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee0aa2-d35b-451d-97bd-ed97fb2bf337 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:36.642123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304b4d5-1e39-4c7d-bfe5-4343f9cc5e2a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:36.706595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:36.708767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5515b84-75db-41b1-91a7-2a3c644d5db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:36.709686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515b84-75db-41b1-91a7-2a3c644d5db6 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:36.710233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515b84-75db-41b1-91a7-2a3c644d5db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:36.710680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515b84-75db-41b1-91a7-2a3c644d5db6 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:36.711574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5515b84-75db-41b1-91a7-2a3c644d5db6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:36.714214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5515b84-75db-41b1-91a7-2a3c644d5db6 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:36.724079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee0aa2-d35b-451d-97bd-ed97fb2bf337 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:36.762065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445f781-026a-476b-a9f8-8bbd0075bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:36.762756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f781-026a-476b-a9f8-8bbd0075bd20 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:36.763036 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f781-026a-476b-a9f8-8bbd0075bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:36.763313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f781-026a-476b-a9f8-8bbd0075bd20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:36.780434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 234/474] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:13:36 2022] POST /identity/v3/users => generated 248 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:13:36.801560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445f781-026a-476b-a9f8-8bbd0075bd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:36.803369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445f781-026a-476b-a9f8-8bbd0075bd20 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-9445f781-026a-476b-a9f8-8bbd0075bd20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:36.823311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:36.824261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:36.825121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:36.825121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:36.825121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:36.825121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 241/475] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:36.831071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5515b84-75db-41b1-91a7-2a3c644d5db6 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:36.860910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445f781-026a-476b-a9f8-8bbd0075bd20 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:36.934872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:36.974463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5515b84-75db-41b1-91a7-2a3c644d5db6 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:37.015193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777ee5-927c-44e9-b5ae-6b1a05d8b424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:37.016778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777ee5-927c-44e9-b5ae-6b1a05d8b424 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:37.017260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777ee5-927c-44e9-b5ae-6b1a05d8b424 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:37.017730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777ee5-927c-44e9-b5ae-6b1a05d8b424 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:37.018156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445f781-026a-476b-a9f8-8bbd0075bd20 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:37.018848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f777ee5-927c-44e9-b5ae-6b1a05d8b424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:37.019415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f777ee5-927c-44e9-b5ae-6b1a05d8b424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:37.021390 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f777ee5-927c-44e9-b5ae-6b1a05d8b424 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:37.035465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 235/476] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:37.042352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777ee5-927c-44e9-b5ae-6b1a05d8b424 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:37.059464 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403188a-e839-431b-b81a-4b4856a68500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:37.060154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403188a-e839-431b-b81a-4b4856a68500 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:37.060350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403188a-e839-431b-b81a-4b4856a68500 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:37.060668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403188a-e839-431b-b81a-4b4856a68500 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:37.061475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403188a-e839-431b-b81a-4b4856a68500 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:37.063011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403188a-e839-431b-b81a-4b4856a68500 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:37.075405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.sql.core [None req-5403188a-e839-431b-b81a-4b4856a68500 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 19:13:37.075405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 19:13:37.075405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [parameters: {'id': '174b0969eaf74b86add2195b6d373e9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 19:13:37.075405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81441) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-5403188a-e839-431b-b81a-4b4856a68500 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result.read() Sep 16 19:13:37.099048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return ref.to_dict() Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:13:37.099994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application yield resource Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise self.value Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application session.commit() Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 19:13:37.101099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.session.flush() Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application compat.raise_( Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 19:13:37.102250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:13:37.103349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result.read() Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:13:37.104355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [parameters: {'id': '174b0969eaf74b86add2195b6d373e9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:37.105721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 19:13:37.107402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:37.109127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 242/477] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Sep 16 19:13:36 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:37.109127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403188a-e839-431b-b81a-4b4856a68500 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:37.123474 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:37.179238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777ee5-927c-44e9-b5ae-6b1a05d8b424 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:37.214970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:37.221594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f22af-97ee-456c-86ed-3456b348de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:37.222550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f22af-97ee-456c-86ed-3456b348de3d None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:37.222899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f22af-97ee-456c-86ed-3456b348de3d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:37.223236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f22af-97ee-456c-86ed-3456b348de3d None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:37.223960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f22af-97ee-456c-86ed-3456b348de3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:37.225560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f22af-97ee-456c-86ed-3456b348de3d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:37.234233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403188a-e839-431b-b81a-4b4856a68500 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:37.254598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 236/478] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:13:37 2022] POST /identity/v3/users => generated 249 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:13:37.278767 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d52d2-a666-45bd-8f63-a288eeca6d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:37.279768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d52d2-a666-45bd-8f63-a288eeca6d48 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:37.280192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d52d2-a666-45bd-8f63-a288eeca6d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:37.280643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d52d2-a666-45bd-8f63-a288eeca6d48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:37.294982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d52d2-a666-45bd-8f63-a288eeca6d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-da0d52d2-a666-45bd-8f63-a288eeca6d48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:37.301392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:37.302555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:13:37.303577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:37.306292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 243/479] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:13:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:37.312460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f22af-97ee-456c-86ed-3456b348de3d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:37.468642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f22af-97ee-456c-86ed-3456b348de3d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:37.504734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75122961-127a-45b4-98c7-a4e56fb5b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:37.505267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75122961-127a-45b4-98c7-a4e56fb5b95c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:37.505542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75122961-127a-45b4-98c7-a4e56fb5b95c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:37.505824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75122961-127a-45b4-98c7-a4e56fb5b95c None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:37.506480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75122961-127a-45b4-98c7-a4e56fb5b95c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:37.506776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75122961-127a-45b4-98c7-a4e56fb5b95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:37.508151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75122961-127a-45b4-98c7-a4e56fb5b95c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:37.516977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 237/480] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:38.837213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd4cd8-ea45-4a49-9159-3366d34a4721 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:38.837771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd4cd8-ea45-4a49-9159-3366d34a4721 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:38.837771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd4cd8-ea45-4a49-9159-3366d34a4721 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:38.839464 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 244/481] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:38.844270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09486ab8-1c52-4d31-915c-021bafe6cd6d None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:38.844681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09486ab8-1c52-4d31-915c-021bafe6cd6d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:38.844865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09486ab8-1c52-4d31-915c-021bafe6cd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:38.873437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-09486ab8-1c52-4d31-915c-021bafe6cd6d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:38.874661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-09486ab8-1c52-4d31-915c-021bafe6cd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:38.936815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:38.960801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 238/482] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:39.302953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd4cd8-ea45-4a49-9159-3366d34a4721 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:39.389839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:39.437960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd4cd8-ea45-4a49-9159-3366d34a4721 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:39.489971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e48b7-aece-4ad4-a17f-e6f6d1bc0e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:39.490615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e48b7-aece-4ad4-a17f-e6f6d1bc0e33 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:39.490888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e48b7-aece-4ad4-a17f-e6f6d1bc0e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:39.491154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e48b7-aece-4ad4-a17f-e6f6d1bc0e33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:39.503177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6532-6cc7-433d-819e-fb7495cf0701 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:39.503489 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6532-6cc7-433d-819e-fb7495cf0701 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:39.503829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6532-6cc7-433d-819e-fb7495cf0701 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:39.506631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 239/483] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:39.506966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e48b7-aece-4ad4-a17f-e6f6d1bc0e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:39.510749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43226f-3b21-482a-889f-bc88d2ec004f None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:39.511150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43226f-3b21-482a-889f-bc88d2ec004f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:39.511433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43226f-3b21-482a-889f-bc88d2ec004f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-688e48b7-aece-4ad4-a17f-e6f6d1bc0e33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:39.515104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:39.516002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:39.516818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 245/484] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:39.523524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e48b7-aece-4ad4-a17f-e6f6d1bc0e33 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:39.533060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-0b43226f-3b21-482a-889f-bc88d2ec004f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:39.534363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0b43226f-3b21-482a-889f-bc88d2ec004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:39.666080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 240/485] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:39.706750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984df62-e576-4018-86b9-d392c314db56 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:39.707092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984df62-e576-4018-86b9-d392c314db56 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:39.707092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984df62-e576-4018-86b9-d392c314db56 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:39.708546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 241/486] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:13:39.711910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e48b7-aece-4ad4-a17f-e6f6d1bc0e33 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:39.713594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d1409-f526-45ea-a4a9-fc66057a3bbe None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:39.713872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d1409-f526-45ea-a4a9-fc66057a3bbe None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:39.714142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d1409-f526-45ea-a4a9-fc66057a3bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:39.741803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-df6d1409-f526-45ea-a4a9-fc66057a3bbe None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:39.742959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-df6d1409-f526-45ea-a4a9-fc66057a3bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:39.773441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:39.783349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f290-8daf-4d5d-810b-7dc761782b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:39.784250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f290-8daf-4d5d-810b-7dc761782b43 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:39.784750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f290-8daf-4d5d-810b-7dc761782b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:39.785245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f290-8daf-4d5d-810b-7dc761782b43 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:39.786145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4f290-8daf-4d5d-810b-7dc761782b43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:39.786593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4f290-8daf-4d5d-810b-7dc761782b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:39.788183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4f290-8daf-4d5d-810b-7dc761782b43 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:39.797088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 246/487] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:39.802340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f290-8daf-4d5d-810b-7dc761782b43 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:39.859077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 242/488] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 16 19:13:39.955733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f290-8daf-4d5d-810b-7dc761782b43 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:39.990104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1249cf-8894-423d-978c-b1c43dba5d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:39.990752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1249cf-8894-423d-978c-b1c43dba5d8d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:39.991028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1249cf-8894-423d-978c-b1c43dba5d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:39.991304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1249cf-8894-423d-978c-b1c43dba5d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.002472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1249cf-8894-423d-978c-b1c43dba5d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:40.004059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1249cf-8894-423d-978c-b1c43dba5d8d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-ac1249cf-8894-423d-978c-b1c43dba5d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:40.018669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:40.019727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:40.020953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:40.020953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:40.020953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:40.020953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 247/489] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:40.025704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d1409-f526-45ea-a4a9-fc66057a3bbe None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:40.054295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1249cf-8894-423d-978c-b1c43dba5d8d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:40.100041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:40.136172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:40.189181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d1409-f526-45ea-a4a9-fc66057a3bbe None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:40.216090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1249cf-8894-423d-978c-b1c43dba5d8d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:40.227377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7de18e-a50e-4cd3-9ffe-1afaa94d3d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:40.228180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7de18e-a50e-4cd3-9ffe-1afaa94d3d7c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.228763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7de18e-a50e-4cd3-9ffe-1afaa94d3d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.229177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7de18e-a50e-4cd3-9ffe-1afaa94d3d7c None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.230058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7de18e-a50e-4cd3-9ffe-1afaa94d3d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:40.230510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7de18e-a50e-4cd3-9ffe-1afaa94d3d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:40.232199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7de18e-a50e-4cd3-9ffe-1afaa94d3d7c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:40.245019 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 243/490] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:40.246504 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4856-8466-450b-80e0-f917af63c07b None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.246790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4856-8466-450b-80e0-f917af63c07b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.247066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4856-8466-450b-80e0-f917af63c07b None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.248478 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 244/491] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:40.249136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c4856-8466-450b-80e0-f917af63c07b None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:40.254615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57717737-4b98-4524-b625-6e54197870a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:40.255529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717737-4b98-4524-b625-6e54197870a0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.256028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717737-4b98-4524-b625-6e54197870a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.256545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717737-4b98-4524-b625-6e54197870a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.271311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57717737-4b98-4524-b625-6e54197870a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-57717737-4b98-4524-b625-6e54197870a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:40.279240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:40.280210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:40.281042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:40.281672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 248/492] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:40.282685 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57717737-4b98-4524-b625-6e54197870a0 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:40.368683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:40.373459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c4856-8466-450b-80e0-f917af63c07b None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:40.396156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57717737-4b98-4524-b625-6e54197870a0 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:40.397858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:40.409137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ff160-0cba-4e19-a914-6d8e88d1c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:40.409809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ff160-0cba-4e19-a914-6d8e88d1c0fa None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.410085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ff160-0cba-4e19-a914-6d8e88d1c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.410360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ff160-0cba-4e19-a914-6d8e88d1c0fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.421739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ff160-0cba-4e19-a914-6d8e88d1c0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-b10ff160-0cba-4e19-a914-6d8e88d1c0fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:40.426650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:40.427524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:40.428307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 245/493] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:40.429501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2587dc-8726-4f02-a05f-c6ff020ddf3b None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.429501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2587dc-8726-4f02-a05f-c6ff020ddf3b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.429765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2587dc-8726-4f02-a05f-c6ff020ddf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.435867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2950ea-ab8f-4cde-8823-1b8817b005f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:40.436544 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2950ea-ab8f-4cde-8823-1b8817b005f0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.436817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2950ea-ab8f-4cde-8823-1b8817b005f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.437083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2950ea-ab8f-4cde-8823-1b8817b005f0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.444279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2950ea-ab8f-4cde-8823-1b8817b005f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:40.446119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2950ea-ab8f-4cde-8823-1b8817b005f0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:40.448284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-3a2587dc-8726-4f02-a05f-c6ff020ddf3b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:40.449521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3a2587dc-8726-4f02-a05f-c6ff020ddf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-de2950ea-ab8f-4cde-8823-1b8817b005f0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:40.459351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:40.460368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 249/494] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:40.461719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2950ea-ab8f-4cde-8823-1b8817b005f0 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:40.519797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 246/495] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:40.521079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252050a-2703-4cb3-88d8-d5e42b50aaf5 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.521353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252050a-2703-4cb3-88d8-d5e42b50aaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.521618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252050a-2703-4cb3-88d8-d5e42b50aaf5 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.522837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 247/496] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:40.523511 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252050a-2703-4cb3-88d8-d5e42b50aaf5 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:40.577847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2950ea-ab8f-4cde-8823-1b8817b005f0 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:40.613300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa756-9805-4a62-aef3-6a7fb27b39be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:40.613995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa756-9805-4a62-aef3-6a7fb27b39be None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.614290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa756-9805-4a62-aef3-6a7fb27b39be None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.614555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa756-9805-4a62-aef3-6a7fb27b39be None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.615216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fa756-9805-4a62-aef3-6a7fb27b39be None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:40.615522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fa756-9805-4a62-aef3-6a7fb27b39be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:40.617043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fa756-9805-4a62-aef3-6a7fb27b39be None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:40.619808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:40.630925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252050a-2703-4cb3-88d8-d5e42b50aaf5 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:40.633413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 250/497] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:40.634189 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa756-9805-4a62-aef3-6a7fb27b39be None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:40.663488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:40.671628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7dee1-d7bb-4a8d-ae52-75760fef058b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:40.672252 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7dee1-d7bb-4a8d-ae52-75760fef058b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.672851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7dee1-d7bb-4a8d-ae52-75760fef058b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.673126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7dee1-d7bb-4a8d-ae52-75760fef058b None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.673792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7dee1-d7bb-4a8d-ae52-75760fef058b None admin] RBAC: Adding query filter params (name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:40.674086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7dee1-d7bb-4a8d-ae52-75760fef058b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:40.675761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7dee1-d7bb-4a8d-ae52-75760fef058b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:40.684422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 248/498] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:40.685046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af582e7-35ea-4dd2-bc6c-d77703394158 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.685325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af582e7-35ea-4dd2-bc6c-d77703394158 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.685755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af582e7-35ea-4dd2-bc6c-d77703394158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.703878 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-8af582e7-35ea-4dd2-bc6c-d77703394158 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:40.705063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8af582e7-35ea-4dd2-bc6c-d77703394158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:40.752679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa756-9805-4a62-aef3-6a7fb27b39be None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:40.779134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 249/499] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:40.779918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af582e7-35ea-4dd2-bc6c-d77703394158 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:40.798712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3bee9-7df4-4dc6-bdf1-7a3bc00d2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:40.799536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3bee9-7df4-4dc6-bdf1-7a3bc00d2c27 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.800527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3bee9-7df4-4dc6-bdf1-7a3bc00d2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.801135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3bee9-7df4-4dc6-bdf1-7a3bc00d2c27 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.802271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3bee9-7df4-4dc6-bdf1-7a3bc00d2c27 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:40.802980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3bee9-7df4-4dc6-bdf1-7a3bc00d2c27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:40.805264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3bee9-7df4-4dc6-bdf1-7a3bc00d2c27 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:40.848651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 251/500] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Sep 16 19:13:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:40.849288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3bee9-7df4-4dc6-bdf1-7a3bc00d2c27 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:40.864885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:40.888238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af582e7-35ea-4dd2-bc6c-d77703394158 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:40.924758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c6c9f-12a7-4ee6-8e6d-b49628cc8f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:40.925750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6c9f-12a7-4ee6-8e6d-b49628cc8f3a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.926202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6c9f-12a7-4ee6-8e6d-b49628cc8f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.926603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6c9f-12a7-4ee6-8e6d-b49628cc8f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:40.935286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:40.938807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c6c9f-12a7-4ee6-8e6d-b49628cc8f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:40.940259 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c6c9f-12a7-4ee6-8e6d-b49628cc8f3a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:40.955066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3bee9-7df4-4dc6-bdf1-7a3bc00d2c27 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-089c6c9f-12a7-4ee6-8e6d-b49628cc8f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:40.955900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:40.956897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:40.957763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:40.957763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:40.957763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:40.957763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 250/501] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:40.957995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c6c9f-12a7-4ee6-8e6d-b49628cc8f3a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:40.993103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ddac5-afcc-4c94-933c-45a61d9b682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:40.993850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ddac5-afcc-4c94-933c-45a61d9b682a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:40.994126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ddac5-afcc-4c94-933c-45a61d9b682a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:40.994398 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ddac5-afcc-4c94-933c-45a61d9b682a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.004785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ddac5-afcc-4c94-933c-45a61d9b682a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.006480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ddac5-afcc-4c94-933c-45a61d9b682a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-032ddac5-afcc-4c94-933c-45a61d9b682a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:41.022048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:41.023002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:41.023848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:41.023848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:41.023848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:41.023848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 252/502] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:41.024061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ddac5-afcc-4c94-933c-45a61d9b682a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.066640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c6c9f-12a7-4ee6-8e6d-b49628cc8f3a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.100998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923702fa-2d84-4753-a144-5b93d776bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.101628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923702fa-2d84-4753-a144-5b93d776bcba None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.101905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923702fa-2d84-4753-a144-5b93d776bcba None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.102177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923702fa-2d84-4753-a144-5b93d776bcba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.103992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:41.113334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923702fa-2d84-4753-a144-5b93d776bcba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-923702fa-2d84-4753-a144-5b93d776bcba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:41.118608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:41.119539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 251/503] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:41.121437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923702fa-2d84-4753-a144-5b93d776bcba None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.125167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ddac5-afcc-4c94-933c-45a61d9b682a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.159772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b0c01-d81e-44ab-8900-c4c2a67af65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.160377 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b0c01-d81e-44ab-8900-c4c2a67af65a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.160685 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b0c01-d81e-44ab-8900-c4c2a67af65a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.160957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b0c01-d81e-44ab-8900-c4c2a67af65a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.163574 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:41.223818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923702fa-2d84-4753-a144-5b93d776bcba None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.230899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b0c01-d81e-44ab-8900-c4c2a67af65a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.232372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b0c01-d81e-44ab-8900-c4c2a67af65a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:41.257510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee8af-1087-4583-8410-2f1d54343184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.258117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee8af-1087-4583-8410-2f1d54343184 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.258396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee8af-1087-4583-8410-2f1d54343184 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.258674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee8af-1087-4583-8410-2f1d54343184 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.259313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ee8af-1087-4583-8410-2f1d54343184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:41.259623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ee8af-1087-4583-8410-2f1d54343184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.261036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ee8af-1087-4583-8410-2f1d54343184 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:41.272966 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 252/504] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:41.273544 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee8af-1087-4583-8410-2f1d54343184 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.329954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 253/505] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:41.330720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b0c01-d81e-44ab-8900-c4c2a67af65a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.334485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:41.362679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:41.381236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee8af-1087-4583-8410-2f1d54343184 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.421278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b5394-726f-4874-a6b9-b6eef34b73f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.422165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b5394-726f-4874-a6b9-b6eef34b73f0 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.422605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b5394-726f-4874-a6b9-b6eef34b73f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.423048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b5394-726f-4874-a6b9-b6eef34b73f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.424092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b5394-726f-4874-a6b9-b6eef34b73f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:41.424621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b5394-726f-4874-a6b9-b6eef34b73f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.426904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b5394-726f-4874-a6b9-b6eef34b73f0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:41.439568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b0c01-d81e-44ab-8900-c4c2a67af65a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.440044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 253/506] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:41.440730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b5394-726f-4874-a6b9-b6eef34b73f0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.474484 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43095732-a5a8-41a4-984f-8399b5b2b76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.475112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43095732-a5a8-41a4-984f-8399b5b2b76e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.475386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43095732-a5a8-41a4-984f-8399b5b2b76e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.475655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43095732-a5a8-41a4-984f-8399b5b2b76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.485497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43095732-a5a8-41a4-984f-8399b5b2b76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.486945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43095732-a5a8-41a4-984f-8399b5b2b76e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-43095732-a5a8-41a4-984f-8399b5b2b76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:41.501760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:41.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:41.503580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:41.503580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:41.503580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:41.503580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 254/507] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:41.503793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43095732-a5a8-41a4-984f-8399b5b2b76e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.542329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b5394-726f-4874-a6b9-b6eef34b73f0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.555564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:41.576244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185e3c-88cf-4a95-a813-03053dbca072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.576883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185e3c-88cf-4a95-a813-03053dbca072 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.577160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185e3c-88cf-4a95-a813-03053dbca072 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.577487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185e3c-88cf-4a95-a813-03053dbca072 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.578158 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185e3c-88cf-4a95-a813-03053dbca072 None admin] RBAC: Adding query filter params (name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:41.578466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185e3c-88cf-4a95-a813-03053dbca072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.579834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185e3c-88cf-4a95-a813-03053dbca072 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:41.587303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:41.588994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 254/508] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:41.589836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185e3c-88cf-4a95-a813-03053dbca072 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.604201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43095732-a5a8-41a4-984f-8399b5b2b76e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.644338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b26d20-5ca6-4c52-987f-4f6a818cab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.644998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b26d20-5ca6-4c52-987f-4f6a818cab88 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.645279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b26d20-5ca6-4c52-987f-4f6a818cab88 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.645558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b26d20-5ca6-4c52-987f-4f6a818cab88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.653094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b26d20-5ca6-4c52-987f-4f6a818cab88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.654550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b26d20-5ca6-4c52-987f-4f6a818cab88 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-20b26d20-5ca6-4c52-987f-4f6a818cab88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:41.665467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:41.666394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 255/509] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:41.667288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b26d20-5ca6-4c52-987f-4f6a818cab88 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.696293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185e3c-88cf-4a95-a813-03053dbca072 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.731526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89bdb7-de41-432a-a7ac-26899317145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.732157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89bdb7-de41-432a-a7ac-26899317145c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.732491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89bdb7-de41-432a-a7ac-26899317145c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.732764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89bdb7-de41-432a-a7ac-26899317145c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.743428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89bdb7-de41-432a-a7ac-26899317145c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.744953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89bdb7-de41-432a-a7ac-26899317145c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-5a89bdb7-de41-432a-a7ac-26899317145c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:41.760804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:41.761768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:41.762623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:41.762623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:41.762623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:41.762623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 255/510] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:41.763283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89bdb7-de41-432a-a7ac-26899317145c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.780601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b26d20-5ca6-4c52-987f-4f6a818cab88 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.794733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:41.815366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf878-6934-4998-b4e8-2ed959e493b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.816100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf878-6934-4998-b4e8-2ed959e493b9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.816416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf878-6934-4998-b4e8-2ed959e493b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.816694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf878-6934-4998-b4e8-2ed959e493b9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.824492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf878-6934-4998-b4e8-2ed959e493b9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.825957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf878-6934-4998-b4e8-2ed959e493b9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-c8ddf878-6934-4998-b4e8-2ed959e493b9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:41.837002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:41.837956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:41.838856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 256/511] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:41.839421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf878-6934-4998-b4e8-2ed959e493b9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.848273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:41.871876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89bdb7-de41-432a-a7ac-26899317145c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.906766 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3effc6f-0ee7-4715-aca3-b5f7440129d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.907370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3effc6f-0ee7-4715-aca3-b5f7440129d8 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.907645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3effc6f-0ee7-4715-aca3-b5f7440129d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.907942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3effc6f-0ee7-4715-aca3-b5f7440129d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.908608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3effc6f-0ee7-4715-aca3-b5f7440129d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:41.908919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3effc6f-0ee7-4715-aca3-b5f7440129d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.910389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3effc6f-0ee7-4715-aca3-b5f7440129d8 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:41.922626 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 256/512] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:41.923637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3effc6f-0ee7-4715-aca3-b5f7440129d8 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:41.939298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf878-6934-4998-b4e8-2ed959e493b9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:41.979109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bdfbe-4a72-47f3-9b54-821b81ae49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:41.979747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bdfbe-4a72-47f3-9b54-821b81ae49df None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:41.980025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bdfbe-4a72-47f3-9b54-821b81ae49df None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:41.980304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bdfbe-4a72-47f3-9b54-821b81ae49df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:41.990897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bdfbe-4a72-47f3-9b54-821b81ae49df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:41.992401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bdfbe-4a72-47f3-9b54-821b81ae49df None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-948bdfbe-4a72-47f3-9b54-821b81ae49df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:42.007022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:42.008530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:42.009583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:42.009583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:42.009583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:42.012877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:42.013006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 257/513] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:42.013904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bdfbe-4a72-47f3-9b54-821b81ae49df None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:42.028145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3effc6f-0ee7-4715-aca3-b5f7440129d8 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:42.064799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b6369-e0d9-4fa8-bdd6-cc4f3e24aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:42.065408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b6369-e0d9-4fa8-bdd6-cc4f3e24aabe None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:42.065801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b6369-e0d9-4fa8-bdd6-cc4f3e24aabe None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:42.066184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b6369-e0d9-4fa8-bdd6-cc4f3e24aabe None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:42.066914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b6369-e0d9-4fa8-bdd6-cc4f3e24aabe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:42.067219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b6369-e0d9-4fa8-bdd6-cc4f3e24aabe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:42.068686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b6369-e0d9-4fa8-bdd6-cc4f3e24aabe None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:42.073079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:42.106199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 257/514] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Sep 16 19:13:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:42.106950 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b6369-e0d9-4fa8-bdd6-cc4f3e24aabe None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:42.121201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bdfbe-4a72-47f3-9b54-821b81ae49df None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:42.155022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12a050-7250-4ab6-b0c1-0b973b2e426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:42.155625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12a050-7250-4ab6-b0c1-0b973b2e426a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:42.155904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12a050-7250-4ab6-b0c1-0b973b2e426a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:42.156173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12a050-7250-4ab6-b0c1-0b973b2e426a None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:42.156842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12a050-7250-4ab6-b0c1-0b973b2e426a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:42.157143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12a050-7250-4ab6-b0c1-0b973b2e426a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:42.158521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12a050-7250-4ab6-b0c1-0b973b2e426a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:42.174817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 258/515] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:42.174817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12a050-7250-4ab6-b0c1-0b973b2e426a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:42.207292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b6369-e0d9-4fa8-bdd6-cc4f3e24aabe None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:42.239925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5540054-2f2e-4a38-a74f-25941e37c469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:42.240567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5540054-2f2e-4a38-a74f-25941e37c469 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:42.241497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5540054-2f2e-4a38-a74f-25941e37c469 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:42.241497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5540054-2f2e-4a38-a74f-25941e37c469 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:42.241836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5540054-2f2e-4a38-a74f-25941e37c469 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:42.242164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5540054-2f2e-4a38-a74f-25941e37c469 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:42.243610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5540054-2f2e-4a38-a74f-25941e37c469 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:42.260679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 258/516] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Sep 16 19:13:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:42.261788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5540054-2f2e-4a38-a74f-25941e37c469 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:42.265275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:42.274169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12a050-7250-4ab6-b0c1-0b973b2e426a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:42.291760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:42.309531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0256f-ab4d-4752-87ea-5e7519e74bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:42.310143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0256f-ab4d-4752-87ea-5e7519e74bdc None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:42.310392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0256f-ab4d-4752-87ea-5e7519e74bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:42.310681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0256f-ab4d-4752-87ea-5e7519e74bdc None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:42.311323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0256f-ab4d-4752-87ea-5e7519e74bdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:42.312814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0256f-ab4d-4752-87ea-5e7519e74bdc None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:42.345713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 259/517] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:13:42 2022] POST /identity/v3/users => generated 247 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:13:42.346547 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0256f-ab4d-4752-87ea-5e7519e74bdc None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:42.376674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5540054-2f2e-4a38-a74f-25941e37c469 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:42.417904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be69917-d578-41c9-8a73-7729b189e0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:42.418536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be69917-d578-41c9-8a73-7729b189e0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:42.418819 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be69917-d578-41c9-8a73-7729b189e0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:42.419098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be69917-d578-41c9-8a73-7729b189e0f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:42.419745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be69917-d578-41c9-8a73-7729b189e0f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:42.420039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be69917-d578-41c9-8a73-7729b189e0f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:42.421731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be69917-d578-41c9-8a73-7729b189e0f6 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:42.434101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 259/518] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:42.434101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be69917-d578-41c9-8a73-7729b189e0f6 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:42.491190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0256f-ab4d-4752-87ea-5e7519e74bdc None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:42.506610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:42.533569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659aef6-c73f-413e-81b5-0734d112f8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:42.534183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659aef6-c73f-413e-81b5-0734d112f8bf None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:42.534492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659aef6-c73f-413e-81b5-0734d112f8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:42.534760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659aef6-c73f-413e-81b5-0734d112f8bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:42.552426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be69917-d578-41c9-8a73-7729b189e0f6 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:42.584242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:42.590602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31868544-8f88-4509-8688-31dbddda6d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:42.591421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31868544-8f88-4509-8688-31dbddda6d20 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:42.591977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31868544-8f88-4509-8688-31dbddda6d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:42.592253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31868544-8f88-4509-8688-31dbddda6d20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:42.600648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31868544-8f88-4509-8688-31dbddda6d20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:42.602681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31868544-8f88-4509-8688-31dbddda6d20 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:42.610250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659aef6-c73f-413e-81b5-0734d112f8bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:42.611724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659aef6-c73f-413e-81b5-0734d112f8bf None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-31868544-8f88-4509-8688-31dbddda6d20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:42.616956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:42.617796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:42.618651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:42.618651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:42.618651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:42.618651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:42.618651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:42.618651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:42.618651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:42.618651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:42.618651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 260/519] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:42.619565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31868544-8f88-4509-8688-31dbddda6d20 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:42.722168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31868544-8f88-4509-8688-31dbddda6d20 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:42.734636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 260/520] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:42.734636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659aef6-c73f-413e-81b5-0734d112f8bf None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:42.746575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:42.768152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1b6a5-c6be-45c2-aff3-7ae487070d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:42.768915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1b6a5-c6be-45c2-aff3-7ae487070d31 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:42.769298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1b6a5-c6be-45c2-aff3-7ae487070d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:42.769747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1b6a5-c6be-45c2-aff3-7ae487070d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:42.812602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:42.839249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659aef6-c73f-413e-81b5-0734d112f8bf None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:42.843027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1b6a5-c6be-45c2-aff3-7ae487070d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:42.844719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1b6a5-c6be-45c2-aff3-7ae487070d31 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:42.874701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4060a8d-63e9-4cb7-9384-c2eb17827cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:42.875334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4060a8d-63e9-4cb7-9384-c2eb17827cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:42.875607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4060a8d-63e9-4cb7-9384-c2eb17827cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:42.875880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4060a8d-63e9-4cb7-9384-c2eb17827cd3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:42.883752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4060a8d-63e9-4cb7-9384-c2eb17827cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:42.885415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4060a8d-63e9-4cb7-9384-c2eb17827cd3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-c4060a8d-63e9-4cb7-9384-c2eb17827cd3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:42.899655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:42.901008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:42.902623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:42.902623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:42.902623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:42.902623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:42.902623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:42.902623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:42.902623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:42.902623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:42.902623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:13:42.902623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:42.905975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 261/521] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:42.906242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4060a8d-63e9-4cb7-9384-c2eb17827cd3 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:42.958917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 261/522] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:42.959615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1b6a5-c6be-45c2-aff3-7ae487070d31 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:42.985282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:43.010918 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4060a8d-63e9-4cb7-9384-c2eb17827cd3 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:43.046257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a13a-5a76-422c-aee1-40c6e849a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:43.046869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a13a-5a76-422c-aee1-40c6e849a457 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:43.047143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a13a-5a76-422c-aee1-40c6e849a457 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:43.047412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a13a-5a76-422c-aee1-40c6e849a457 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:43.048216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a13a-5a76-422c-aee1-40c6e849a457 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:43.048665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a13a-5a76-422c-aee1-40c6e849a457 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:43.050144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a13a-5a76-422c-aee1-40c6e849a457 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:43.054897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:43.069244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1b6a5-c6be-45c2-aff3-7ae487070d31 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:43.071857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 262/523] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:43.072861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a13a-5a76-422c-aee1-40c6e849a457 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:43.110931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09000054-7166-49a2-b415-215ef49954a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:43.111561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09000054-7166-49a2-b415-215ef49954a4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:43.111842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09000054-7166-49a2-b415-215ef49954a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:43.112110 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09000054-7166-49a2-b415-215ef49954a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:43.123275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09000054-7166-49a2-b415-215ef49954a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:43.124782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09000054-7166-49a2-b415-215ef49954a4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-09000054-7166-49a2-b415-215ef49954a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:43.140488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:43.141407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:43.142251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:43.142251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:43.142251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:43.142251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 262/524] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:43.142476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09000054-7166-49a2-b415-215ef49954a4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:43.181553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a13a-5a76-422c-aee1-40c6e849a457 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:43.217628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1d56-14af-4164-99d6-3ff9cdc7cb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:43.218564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1d56-14af-4164-99d6-3ff9cdc7cb8e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:43.219168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1d56-14af-4164-99d6-3ff9cdc7cb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:43.219577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1d56-14af-4164-99d6-3ff9cdc7cb8e None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:43.221011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca1d56-14af-4164-99d6-3ff9cdc7cb8e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:43.221704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca1d56-14af-4164-99d6-3ff9cdc7cb8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:43.223486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca1d56-14af-4164-99d6-3ff9cdc7cb8e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:43.231244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:43.244769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 263/525] 10.222.0.49 () {56 vars in 1139 bytes} [Fri Sep 16 19:13:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:43.250218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1d56-14af-4164-99d6-3ff9cdc7cb8e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:43.258079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09000054-7166-49a2-b415-215ef49954a4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:43.297138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac6114-52fe-418f-866a-80f18b218f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:43.297765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac6114-52fe-418f-866a-80f18b218f61 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:43.298039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac6114-52fe-418f-866a-80f18b218f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:43.298464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac6114-52fe-418f-866a-80f18b218f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:43.309030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac6114-52fe-418f-866a-80f18b218f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:43.309571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:43.310880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac6114-52fe-418f-866a-80f18b218f61 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-b3ac6114-52fe-418f-866a-80f18b218f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:43.325807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:43.326771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:43.327614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:43.327614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:43.327614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:43.327614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 263/526] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:43.327614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac6114-52fe-418f-866a-80f18b218f61 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:43.367593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1d56-14af-4164-99d6-3ff9cdc7cb8e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:43.402721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b3ea0-0e68-498a-a565-33a1a078e226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:43.403321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b3ea0-0e68-498a-a565-33a1a078e226 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:43.403600 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b3ea0-0e68-498a-a565-33a1a078e226 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:43.403883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b3ea0-0e68-498a-a565-33a1a078e226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:43.404679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b3ea0-0e68-498a-a565-33a1a078e226 None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=7f83a7e0c14541788c92e3d96b839077) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:43.405042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b3ea0-0e68-498a-a565-33a1a078e226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:43.406536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b3ea0-0e68-498a-a565-33a1a078e226 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:43.424711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 264/527] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:43 2022] GET /identity/v3/role_assignments?user.id=7f83a7e0c14541788c92e3d96b839077&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:43.424711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b3ea0-0e68-498a-a565-33a1a078e226 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:43.455215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac6114-52fe-418f-866a-80f18b218f61 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:43.489781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:43.501642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6c5d4-0e0c-499d-9ee0-695cf7e910b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:43.502422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6c5d4-0e0c-499d-9ee0-695cf7e910b0 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:43.502794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6c5d4-0e0c-499d-9ee0-695cf7e910b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:43.503192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6c5d4-0e0c-499d-9ee0-695cf7e910b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:43.503926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6c5d4-0e0c-499d-9ee0-695cf7e910b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:43.504289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6c5d4-0e0c-499d-9ee0-695cf7e910b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:43.506119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6c5d4-0e0c-499d-9ee0-695cf7e910b0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:43.522465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 264/528] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:43.523628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6c5d4-0e0c-499d-9ee0-695cf7e910b0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:43.561873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b3ea0-0e68-498a-a565-33a1a078e226 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:43.584909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:43.606094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b5193-dc8d-42fe-b2ee-c7d085aecf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:43.607157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b5193-dc8d-42fe-b2ee-c7d085aecf1f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:43.607601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b5193-dc8d-42fe-b2ee-c7d085aecf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:43.608005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b5193-dc8d-42fe-b2ee-c7d085aecf1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:43.648440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6c5d4-0e0c-499d-9ee0-695cf7e910b0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:43.684090 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331e63f-dd68-4939-acca-354ca7f0ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:43.684732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331e63f-dd68-4939-acca-354ca7f0ad44 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:43.685009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331e63f-dd68-4939-acca-354ca7f0ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:43.685279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331e63f-dd68-4939-acca-354ca7f0ad44 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:43.686387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331e63f-dd68-4939-acca-354ca7f0ad44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:43.686387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331e63f-dd68-4939-acca-354ca7f0ad44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:43.687762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331e63f-dd68-4939-acca-354ca7f0ad44 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:43.688753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b5193-dc8d-42fe-b2ee-c7d085aecf1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:43.690416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b5193-dc8d-42fe-b2ee-c7d085aecf1f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:43.704733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 265/529] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:43.704733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331e63f-dd68-4939-acca-354ca7f0ad44 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:43.762475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:43.824695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331e63f-dd68-4939-acca-354ca7f0ad44 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:43.829739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 265/530] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:43.829739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b5193-dc8d-42fe-b2ee-c7d085aecf1f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:43.848498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:43.873972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25fcd7-cd2e-4679-85d2-19a7d8297738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:43.874727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25fcd7-cd2e-4679-85d2-19a7d8297738 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:43.875068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25fcd7-cd2e-4679-85d2-19a7d8297738 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:43.875404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25fcd7-cd2e-4679-85d2-19a7d8297738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:43.885213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25fcd7-cd2e-4679-85d2-19a7d8297738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:43.887010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25fcd7-cd2e-4679-85d2-19a7d8297738 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-5e25fcd7-cd2e-4679-85d2-19a7d8297738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:43.902879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:43.903797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:43.904771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:43.904771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:43.904771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:43.904771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:43.904771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:43.904771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:43.904771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:43.904771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:43.906464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 266/531] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:43.907490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25fcd7-cd2e-4679-85d2-19a7d8297738 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:43.948552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b5193-dc8d-42fe-b2ee-c7d085aecf1f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:43.985621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a303b0-d711-4f51-9a13-122b7f7f5b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:43.986612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a303b0-d711-4f51-9a13-122b7f7f5b06 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:43.987082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a303b0-d711-4f51-9a13-122b7f7f5b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:43.987775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a303b0-d711-4f51-9a13-122b7f7f5b06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:43.995209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a303b0-d711-4f51-9a13-122b7f7f5b06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:43.996961 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a303b0-d711-4f51-9a13-122b7f7f5b06 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-b7a303b0-d711-4f51-9a13-122b7f7f5b06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:44.010134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:44.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:44.012354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:44.012354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:44.012354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:44.012354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:44.012354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:44.012354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:44.012354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:44.012354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:44.014587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 266/532] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:44.015543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a303b0-d711-4f51-9a13-122b7f7f5b06 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:44.035533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25fcd7-cd2e-4679-85d2-19a7d8297738 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:44.079935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ba46b-09e8-4d14-9f58-1309c7893eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:44.081084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ba46b-09e8-4d14-9f58-1309c7893eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:44.081864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ba46b-09e8-4d14-9f58-1309c7893eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:44.082130 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ba46b-09e8-4d14-9f58-1309c7893eb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:44.084750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:44.098028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ba46b-09e8-4d14-9f58-1309c7893eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:44.100670 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ba46b-09e8-4d14-9f58-1309c7893eb0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:44.107541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-7b0ba46b-09e8-4d14-9f58-1309c7893eb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:44.121753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:44.122917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:44.123854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:44.123854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:44.123854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:44.123854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 267/533] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:44.124597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ba46b-09e8-4d14-9f58-1309c7893eb0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:44.138915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a303b0-d711-4f51-9a13-122b7f7f5b06 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:44.178190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d39ee4-2e08-49f7-bf4a-0e9e9764494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:44.179296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d39ee4-2e08-49f7-bf4a-0e9e9764494e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:44.179769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d39ee4-2e08-49f7-bf4a-0e9e9764494e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:44.180346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d39ee4-2e08-49f7-bf4a-0e9e9764494e None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:44.181329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d39ee4-2e08-49f7-bf4a-0e9e9764494e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:44.181877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d39ee4-2e08-49f7-bf4a-0e9e9764494e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:44.183832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d39ee4-2e08-49f7-bf4a-0e9e9764494e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:44.198649 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 267/534] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:44.199984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d39ee4-2e08-49f7-bf4a-0e9e9764494e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:44.251419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ba46b-09e8-4d14-9f58-1309c7893eb0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:44.290743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ab853-c5b6-4779-85c1-64c1e7d06c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:44.291714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ab853-c5b6-4779-85c1-64c1e7d06c29 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:44.292195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ab853-c5b6-4779-85c1-64c1e7d06c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:44.292711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ab853-c5b6-4779-85c1-64c1e7d06c29 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:44.293674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ab853-c5b6-4779-85c1-64c1e7d06c29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:44.294167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ab853-c5b6-4779-85c1-64c1e7d06c29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:44.295892 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ab853-c5b6-4779-85c1-64c1e7d06c29 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:44.320813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 268/535] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:44.321312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d39ee4-2e08-49f7-bf4a-0e9e9764494e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:44.322280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ab853-c5b6-4779-85c1-64c1e7d06c29 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:44.346089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:44.364938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4f14-706d-4ec6-b84a-ed44e4b8c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:44.366019 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4f14-706d-4ec6-b84a-ed44e4b8c812 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:44.366583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4f14-706d-4ec6-b84a-ed44e4b8c812 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:44.367048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4f14-706d-4ec6-b84a-ed44e4b8c812 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:44.367907 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd4f14-706d-4ec6-b84a-ed44e4b8c812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:44.368441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd4f14-706d-4ec6-b84a-ed44e4b8c812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:44.370094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd4f14-706d-4ec6-b84a-ed44e4b8c812 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:44.373856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:44.388033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 268/536] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:44.389296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4f14-706d-4ec6-b84a-ed44e4b8c812 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:44.451992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ab853-c5b6-4779-85c1-64c1e7d06c29 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:44.496241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60d839-4a56-4155-ad25-6fe01d884b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:44.496880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60d839-4a56-4155-ad25-6fe01d884b46 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:44.497155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60d839-4a56-4155-ad25-6fe01d884b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:44.497424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60d839-4a56-4155-ad25-6fe01d884b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:44.498568 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60d839-4a56-4155-ad25-6fe01d884b46 None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=f9988b9fef5c4d559b1918ffe040aaa8) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:44.498876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60d839-4a56-4155-ad25-6fe01d884b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:44.500847 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60d839-4a56-4155-ad25-6fe01d884b46 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:44.507944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4f14-706d-4ec6-b84a-ed44e4b8c812 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:44.508712 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 269/537] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:44 2022] GET /identity/v3/role_assignments?user.id=f9988b9fef5c4d559b1918ffe040aaa8&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:44.509518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60d839-4a56-4155-ad25-6fe01d884b46 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:44.570157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c50b3-e142-405a-a03d-e52cc2b59ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:44.570755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c50b3-e142-405a-a03d-e52cc2b59ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:44.571032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c50b3-e142-405a-a03d-e52cc2b59ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:44.571307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c50b3-e142-405a-a03d-e52cc2b59ae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:44.572227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c50b3-e142-405a-a03d-e52cc2b59ae4 None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=f932b95e90774030b003f554d9f90481) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:44.572600 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c50b3-e142-405a-a03d-e52cc2b59ae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:44.574140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c50b3-e142-405a-a03d-e52cc2b59ae4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:44.580884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 269/538] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:44 2022] GET /identity/v3/role_assignments?user.id=f932b95e90774030b003f554d9f90481&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:44.582264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7379fea-85ad-4004-aeb2-e3418e2533c7 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:44.582549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7379fea-85ad-4004-aeb2-e3418e2533c7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:44.582825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7379fea-85ad-4004-aeb2-e3418e2533c7 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:44.588788 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 270/539] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:44.590202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ea9d-1b13-4d93-9859-a170658a97a8 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:44.590847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ea9d-1b13-4d93-9859-a170658a97a8 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:44.590983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ea9d-1b13-4d93-9859-a170658a97a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:44.613423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-7527ea9d-1b13-4d93-9859-a170658a97a8 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:44.615300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7527ea9d-1b13-4d93-9859-a170658a97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:44.648075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:44.671358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60d839-4a56-4155-ad25-6fe01d884b46 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:44.708418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:44.736754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 271/540] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:44.755830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cc056-c251-4edd-9594-33436ed0c4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:44.755830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cc056-c251-4edd-9594-33436ed0c4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:44.755830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cc056-c251-4edd-9594-33436ed0c4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:44.755830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cc056-c251-4edd-9594-33436ed0c4c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:44.767617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cc056-c251-4edd-9594-33436ed0c4c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:44.767617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cc056-c251-4edd-9594-33436ed0c4c0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-2e0cc056-c251-4edd-9594-33436ed0c4c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:44.787613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:44.788607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:44.789452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:44.789452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:44.789452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:44.789452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:44.789452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:44.789452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:44.789452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:44.789452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:44.789452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 270/541] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:44.797558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ea9d-1b13-4d93-9859-a170658a97a8 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:44.931374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ea9d-1b13-4d93-9859-a170658a97a8 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:44.978053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d5972-1461-4f25-8e49-eae89ea79eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:44.978673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d5972-1461-4f25-8e49-eae89ea79eba None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:44.978946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d5972-1461-4f25-8e49-eae89ea79eba None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:44.979220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d5972-1461-4f25-8e49-eae89ea79eba None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:44.979918 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d5972-1461-4f25-8e49-eae89ea79eba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:44.980218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d5972-1461-4f25-8e49-eae89ea79eba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:44.981681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d5972-1461-4f25-8e49-eae89ea79eba None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:44.999280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 272/542] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:45.005218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cc056-c251-4edd-9594-33436ed0c4c0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:45.014914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d5972-1461-4f25-8e49-eae89ea79eba None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:45.109911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:45.194412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cc056-c251-4edd-9594-33436ed0c4c0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:45.197157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d5972-1461-4f25-8e49-eae89ea79eba None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:45.265107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c8cc1-18f7-419b-82eb-886ea9932b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:45.266089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cbca5-de7a-4299-9c68-8c1b5406399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:45.266987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cbca5-de7a-4299-9c68-8c1b5406399d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:45.267877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8cc1-18f7-419b-82eb-886ea9932b65 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:45.268352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cbca5-de7a-4299-9c68-8c1b5406399d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:45.268919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8cc1-18f7-419b-82eb-886ea9932b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:45.269403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cbca5-de7a-4299-9c68-8c1b5406399d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:45.269866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8cc1-18f7-419b-82eb-886ea9932b65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:45.270791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cbca5-de7a-4299-9c68-8c1b5406399d None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=32ca32d96f9a436782ef0680f6b5dcac) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:45.271807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cbca5-de7a-4299-9c68-8c1b5406399d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:45.273697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cbca5-de7a-4299-9c68-8c1b5406399d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:45.285910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 271/543] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:45 2022] GET /identity/v3/role_assignments?user.id=32ca32d96f9a436782ef0680f6b5dcac&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:45.296182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c8cc1-18f7-419b-82eb-886ea9932b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-d78c8cc1-18f7-419b-82eb-886ea9932b65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:45.301849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:45.302811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:45.303608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 273/544] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:45.309268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cbca5-de7a-4299-9c68-8c1b5406399d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:45.331247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:45.484933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cbca5-de7a-4299-9c68-8c1b5406399d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:45.527627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84259-fe5d-446e-ba08-0784e9c5d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:45.528247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84259-fe5d-446e-ba08-0784e9c5d973 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:45.528551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84259-fe5d-446e-ba08-0784e9c5d973 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:45.528821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84259-fe5d-446e-ba08-0784e9c5d973 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:45.529502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d84259-fe5d-446e-ba08-0784e9c5d973 None admin] RBAC: Adding query filter params (name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:45.529799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d84259-fe5d-446e-ba08-0784e9c5d973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:45.531171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d84259-fe5d-446e-ba08-0784e9c5d973 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:45.540585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 272/545] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:45.546001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c8cc1-18f7-419b-82eb-886ea9932b65 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:45.716277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c8cc1-18f7-419b-82eb-886ea9932b65 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:45.728291 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:45.759794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b3475-d674-4e5a-9725-e8159ee1fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:45.760359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b3475-d674-4e5a-9725-e8159ee1fc93 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:45.760656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b3475-d674-4e5a-9725-e8159ee1fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:45.760921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b3475-d674-4e5a-9725-e8159ee1fc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:45.772088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b3475-d674-4e5a-9725-e8159ee1fc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:45.773670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b3475-d674-4e5a-9725-e8159ee1fc93 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-0f5b3475-d674-4e5a-9725-e8159ee1fc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:45.792367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:45.793345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:45.794196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:45.794196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:45.794196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:45.794196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 274/546] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:45.799439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84259-fe5d-446e-ba08-0784e9c5d973 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:45.842368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d22fc-cf93-494f-8095-cb375cd9e21b None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:45.842715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d22fc-cf93-494f-8095-cb375cd9e21b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:45.842906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d22fc-cf93-494f-8095-cb375cd9e21b None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:45.844509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 275/547] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:45.849825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339fca8-6f90-4331-a625-f2cdde1c053a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:45.850103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339fca8-6f90-4331-a625-f2cdde1c053a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:45.850373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339fca8-6f90-4331-a625-f2cdde1c053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:45.881534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0339fca8-6f90-4331-a625-f2cdde1c053a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:45.882764 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0339fca8-6f90-4331-a625-f2cdde1c053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:45.895463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:45.934560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84259-fe5d-446e-ba08-0784e9c5d973 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:45.982796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14291a-b8be-4891-ad8f-19cc4f27b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:45.983417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14291a-b8be-4891-ad8f-19cc4f27b201 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:45.983694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14291a-b8be-4891-ad8f-19cc4f27b201 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:45.983963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14291a-b8be-4891-ad8f-19cc4f27b201 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:45.984633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14291a-b8be-4891-ad8f-19cc4f27b201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:45.984938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14291a-b8be-4891-ad8f-19cc4f27b201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:45.986305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14291a-b8be-4891-ad8f-19cc4f27b201 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:46.010689 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 273/548] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:46.015744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 276/549] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:46.016199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14291a-b8be-4891-ad8f-19cc4f27b201 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:46.123071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14291a-b8be-4891-ad8f-19cc4f27b201 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:46.154354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:46.166474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c66eb-c1c4-40a0-ad05-2433b4acbd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:46.167125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c66eb-c1c4-40a0-ad05-2433b4acbd1b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:46.167400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c66eb-c1c4-40a0-ad05-2433b4acbd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:46.167671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c66eb-c1c4-40a0-ad05-2433b4acbd1b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:46.176176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c66eb-c1c4-40a0-ad05-2433b4acbd1b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:46.177679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c66eb-c1c4-40a0-ad05-2433b4acbd1b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-771c66eb-c1c4-40a0-ad05-2433b4acbd1b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:46.198577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:46.200592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:46.201587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 274/550] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:13:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:46.205420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339fca8-6f90-4331-a625-f2cdde1c053a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:46.327119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339fca8-6f90-4331-a625-f2cdde1c053a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:46.328728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:46.362213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d930f-fa8e-4889-865b-704184ee48aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:46.362874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d930f-fa8e-4889-865b-704184ee48aa None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:46.363151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d930f-fa8e-4889-865b-704184ee48aa None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:46.363481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d930f-fa8e-4889-865b-704184ee48aa None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:46.364213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d930f-fa8e-4889-865b-704184ee48aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:46.364579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d930f-fa8e-4889-865b-704184ee48aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:46.366016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d930f-fa8e-4889-865b-704184ee48aa None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:46.384108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 277/551] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Sep 16 19:13:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:46.393552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c66eb-c1c4-40a0-ad05-2433b4acbd1b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:46.480630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d930f-fa8e-4889-865b-704184ee48aa None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:46.557447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c66eb-c1c4-40a0-ad05-2433b4acbd1b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:46.616894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b5bf9-44b3-4ed7-a297-7624b995d94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:46.617423 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b5bf9-44b3-4ed7-a297-7624b995d94b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:46.617700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b5bf9-44b3-4ed7-a297-7624b995d94b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:46.617967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b5bf9-44b3-4ed7-a297-7624b995d94b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:46.655173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d930f-fa8e-4889-865b-704184ee48aa None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:46.689951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:46.702433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b5bf9-44b3-4ed7-a297-7624b995d94b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:46.704325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b5bf9-44b3-4ed7-a297-7624b995d94b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:46.755603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb5a9-f898-4e33-a0e5-71a20ab3a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:46.755603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb5a9-f898-4e33-a0e5-71a20ab3a121 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:46.755603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb5a9-f898-4e33-a0e5-71a20ab3a121 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:46.755603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb5a9-f898-4e33-a0e5-71a20ab3a121 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:46.773277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeb5a9-f898-4e33-a0e5-71a20ab3a121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-4adeb5a9-f898-4e33-a0e5-71a20ab3a121 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:46.778941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:46.779939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:46.780800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:46.782541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 278/552] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:46.788001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb5a9-f898-4e33-a0e5-71a20ab3a121 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:46.812307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:46.892780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 275/553] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:46.897996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b5bf9-44b3-4ed7-a297-7624b995d94b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:46.993792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:46.994537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb5a9-f898-4e33-a0e5-71a20ab3a121 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:47.004272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b5bf9-44b3-4ed7-a297-7624b995d94b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:47.040422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10bbab-d605-4fe5-8370-76d117aa2a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:47.041127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bbab-d605-4fe5-8370-76d117aa2a96 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.041403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bbab-d605-4fe5-8370-76d117aa2a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.041669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bbab-d605-4fe5-8370-76d117aa2a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.052637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10bbab-d605-4fe5-8370-76d117aa2a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:47.054192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10bbab-d605-4fe5-8370-76d117aa2a96 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-fb10bbab-d605-4fe5-8370-76d117aa2a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:47.072207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:47.073309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:47.074172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:47.074172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:47.074172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:47.074172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 276/554] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:47.081517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10bbab-d605-4fe5-8370-76d117aa2a96 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:47.092851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f59600-9b93-43cb-a4cd-5397cb7a1f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:47.094136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f59600-9b93-43cb-a4cd-5397cb7a1f2d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.094603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f59600-9b93-43cb-a4cd-5397cb7a1f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.096217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f59600-9b93-43cb-a4cd-5397cb7a1f2d None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.097155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f59600-9b93-43cb-a4cd-5397cb7a1f2d None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:47.099463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f59600-9b93-43cb-a4cd-5397cb7a1f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:47.101150 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f59600-9b93-43cb-a4cd-5397cb7a1f2d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:47.118194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 279/555] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:47.124582 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f59600-9b93-43cb-a4cd-5397cb7a1f2d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:47.233774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10bbab-d605-4fe5-8370-76d117aa2a96 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:47.273321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1989623-7b9a-4097-8a2f-bce8231353a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:47.275143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989623-7b9a-4097-8a2f-bce8231353a2 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.275420 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989623-7b9a-4097-8a2f-bce8231353a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.275689 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989623-7b9a-4097-8a2f-bce8231353a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.276338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1989623-7b9a-4097-8a2f-bce8231353a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:47.276663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1989623-7b9a-4097-8a2f-bce8231353a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:47.278041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1989623-7b9a-4097-8a2f-bce8231353a2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:47.289931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:47.303998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 277/556] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:47.303998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b50d6-5677-4072-ba20-0a9204e62a7d None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.303998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b50d6-5677-4072-ba20-0a9204e62a7d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.303998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b50d6-5677-4072-ba20-0a9204e62a7d None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.303998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 278/557] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:47.306123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b50d6-5677-4072-ba20-0a9204e62a7d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:47.312978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:47.336224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f59600-9b93-43cb-a4cd-5397cb7a1f2d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:47.377754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3d609-13b1-4ff3-9d31-a27cbebb845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:47.379098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3d609-13b1-4ff3-9d31-a27cbebb845c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.379660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3d609-13b1-4ff3-9d31-a27cbebb845c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.380152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3d609-13b1-4ff3-9d31-a27cbebb845c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.392552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3d609-13b1-4ff3-9d31-a27cbebb845c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:47.395943 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3d609-13b1-4ff3-9d31-a27cbebb845c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-a2e3d609-13b1-4ff3-9d31-a27cbebb845c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:47.413626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:47.414660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:47.415668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:47.415668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:47.415668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:47.418113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 280/558] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:47.419829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d7beb-4c8d-4693-850f-40056178e763 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.420415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d7beb-4c8d-4693-850f-40056178e763 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.420880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b50d6-5677-4072-ba20-0a9204e62a7d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:47.420989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d7beb-4c8d-4693-850f-40056178e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.441863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-804d7beb-4c8d-4693-850f-40056178e763 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:47.443621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-804d7beb-4c8d-4693-850f-40056178e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:47.459491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efefbf-2cec-4624-bb9e-a4a7de3bdd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:47.460129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efefbf-2cec-4624-bb9e-a4a7de3bdd17 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.460424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efefbf-2cec-4624-bb9e-a4a7de3bdd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.460696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efefbf-2cec-4624-bb9e-a4a7de3bdd17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.468513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efefbf-2cec-4624-bb9e-a4a7de3bdd17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:47.469948 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efefbf-2cec-4624-bb9e-a4a7de3bdd17 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-e1efefbf-2cec-4624-bb9e-a4a7de3bdd17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:47.483146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:47.484191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:47.485116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:47.485116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:47.485116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:47.485116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:47.485116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:47.485116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:47.485116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:47.485116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:47.485116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 279/559] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:47.485596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efefbf-2cec-4624-bb9e-a4a7de3bdd17 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:47.521991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 281/560] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:47.533871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7fc01-997e-4581-9b6d-498f1a5d98ba None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.535217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7fc01-997e-4581-9b6d-498f1a5d98ba None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.535704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7fc01-997e-4581-9b6d-498f1a5d98ba None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.537830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 282/561] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:47 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:47.542622 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7fc01-997e-4581-9b6d-498f1a5d98ba None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:47.563565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:47.611903 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efefbf-2cec-4624-bb9e-a4a7de3bdd17 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:47.617201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:47.652437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5ded7-c9eb-4306-9eda-2f55fe7ae3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:47.653427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ded7-c9eb-4306-9eda-2f55fe7ae3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.653957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ded7-c9eb-4306-9eda-2f55fe7ae3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.654323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ded7-c9eb-4306-9eda-2f55fe7ae3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.655065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5ded7-c9eb-4306-9eda-2f55fe7ae3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:47.655462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5ded7-c9eb-4306-9eda-2f55fe7ae3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:47.657505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5ded7-c9eb-4306-9eda-2f55fe7ae3c2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:47.671833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 280/562] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:47.678788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af24ff0-8170-4bec-8bc6-adbc2df66295 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.678788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af24ff0-8170-4bec-8bc6-adbc2df66295 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.678788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af24ff0-8170-4bec-8bc6-adbc2df66295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.688584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7fc01-997e-4581-9b6d-498f1a5d98ba None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:47.697630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2af24ff0-8170-4bec-8bc6-adbc2df66295 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:47.698929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2af24ff0-8170-4bec-8bc6-adbc2df66295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:47.728426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a21f69-b6c4-4982-bdcd-34066a959956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:47.729035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a21f69-b6c4-4982-bdcd-34066a959956 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.729310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a21f69-b6c4-4982-bdcd-34066a959956 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.729677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a21f69-b6c4-4982-bdcd-34066a959956 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.730259 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a21f69-b6c4-4982-bdcd-34066a959956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:47.730559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a21f69-b6c4-4982-bdcd-34066a959956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:47.732002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a21f69-b6c4-4982-bdcd-34066a959956 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:47.743719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 283/563] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:47.744471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a21f69-b6c4-4982-bdcd-34066a959956 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:47.783531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 281/564] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:47.784998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8089cf4-cd91-4845-869e-50e1e07c4a4b None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.785281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8089cf4-cd91-4845-869e-50e1e07c4a4b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.785552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8089cf4-cd91-4845-869e-50e1e07c4a4b None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.786910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 282/565] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:47.791558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8089cf4-cd91-4845-869e-50e1e07c4a4b None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:47.861121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:47.868801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a21f69-b6c4-4982-bdcd-34066a959956 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:47.884510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:47.906227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e5856-adc7-48c2-8561-b34b5470357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:47.906868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e5856-adc7-48c2-8561-b34b5470357b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.907142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e5856-adc7-48c2-8561-b34b5470357b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.907407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e5856-adc7-48c2-8561-b34b5470357b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.915482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e5856-adc7-48c2-8561-b34b5470357b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:47.916367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8089cf4-cd91-4845-869e-50e1e07c4a4b None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:47.917050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e5856-adc7-48c2-8561-b34b5470357b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-c52e5856-adc7-48c2-8561-b34b5470357b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:47.928426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:47.929374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:47.930330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 284/566] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:47.931531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df4c17-dc2b-44df-873c-59d1fee8d076 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.931531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df4c17-dc2b-44df-873c-59d1fee8d076 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.931531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df4c17-dc2b-44df-873c-59d1fee8d076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.950321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-87df4c17-dc2b-44df-873c-59d1fee8d076 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:47.951498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-87df4c17-dc2b-44df-873c-59d1fee8d076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:47.958673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda19e9-dea9-4ae8-8b8f-e46a52ccab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:47.959702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda19e9-dea9-4ae8-8b8f-e46a52ccab3d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:47.959972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda19e9-dea9-4ae8-8b8f-e46a52ccab3d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:47.960241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda19e9-dea9-4ae8-8b8f-e46a52ccab3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:47.961343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda19e9-dea9-4ae8-8b8f-e46a52ccab3d None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=94828db5fc064a539b5b7b17cac1602b) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:47.961658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda19e9-dea9-4ae8-8b8f-e46a52ccab3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:47.963396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda19e9-dea9-4ae8-8b8f-e46a52ccab3d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:47.980575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 283/567] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:47 2022] GET /identity/v3/role_assignments?user.id=94828db5fc064a539b5b7b17cac1602b&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:47.980575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda19e9-dea9-4ae8-8b8f-e46a52ccab3d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.038730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 285/568] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:48.039604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df4c17-dc2b-44df-873c-59d1fee8d076 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.120890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda19e9-dea9-4ae8-8b8f-e46a52ccab3d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:48.142186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:48.169614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135e90c-d377-4eeb-b755-7da8c8d8e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:48.170205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135e90c-d377-4eeb-b755-7da8c8d8e9de None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:48.170480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135e90c-d377-4eeb-b755-7da8c8d8e9de None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:48.171997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135e90c-d377-4eeb-b755-7da8c8d8e9de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:48.183665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135e90c-d377-4eeb-b755-7da8c8d8e9de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:48.184874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df4c17-dc2b-44df-873c-59d1fee8d076 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:48.188111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-4135e90c-d377-4eeb-b755-7da8c8d8e9de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:48.188929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:48.189874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:48.190832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 284/569] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:48.196437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135e90c-d377-4eeb-b755-7da8c8d8e9de None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.237637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad99f9a-ca64-495b-a39a-ebecc3df6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:48.238368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad99f9a-ca64-495b-a39a-ebecc3df6416 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:48.238648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad99f9a-ca64-495b-a39a-ebecc3df6416 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:48.238918 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad99f9a-ca64-495b-a39a-ebecc3df6416 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:48.239654 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad99f9a-ca64-495b-a39a-ebecc3df6416 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:48.239954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad99f9a-ca64-495b-a39a-ebecc3df6416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:48.241466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad99f9a-ca64-495b-a39a-ebecc3df6416 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:48.264509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 286/570] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:48.265578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad99f9a-ca64-495b-a39a-ebecc3df6416 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.312472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135e90c-d377-4eeb-b755-7da8c8d8e9de None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:48.357237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4f1da-b1a9-4c61-93ea-dcc77c37d990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:48.357883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4f1da-b1a9-4c61-93ea-dcc77c37d990 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:48.358162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4f1da-b1a9-4c61-93ea-dcc77c37d990 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:48.358435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4f1da-b1a9-4c61-93ea-dcc77c37d990 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:48.369010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4f1da-b1a9-4c61-93ea-dcc77c37d990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-0db4f1da-b1a9-4c61-93ea-dcc77c37d990 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:48.374279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:48.375413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 285/571] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:48.376615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4f1da-b1a9-4c61-93ea-dcc77c37d990 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.397973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad99f9a-ca64-495b-a39a-ebecc3df6416 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:48.416487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:48.437732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afac8f-d29c-43eb-8756-0f3c6df6ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:48.438555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afac8f-d29c-43eb-8756-0f3c6df6ed2a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:48.438672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afac8f-d29c-43eb-8756-0f3c6df6ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:48.438883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afac8f-d29c-43eb-8756-0f3c6df6ed2a None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:48.439547 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afac8f-d29c-43eb-8756-0f3c6df6ed2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:48.439850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afac8f-d29c-43eb-8756-0f3c6df6ed2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:48.441772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afac8f-d29c-43eb-8756-0f3c6df6ed2a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:48.455387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 287/572] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:48.455387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afac8f-d29c-43eb-8756-0f3c6df6ed2a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.482410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:48.491714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4f1da-b1a9-4c61-93ea-dcc77c37d990 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:48.527740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b947f-9d02-40e4-abee-80352a56f351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:48.528401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b947f-9d02-40e4-abee-80352a56f351 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:48.528682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b947f-9d02-40e4-abee-80352a56f351 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:48.528951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b947f-9d02-40e4-abee-80352a56f351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:48.540824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b947f-9d02-40e4-abee-80352a56f351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:48.542304 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b947f-9d02-40e4-abee-80352a56f351 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-847b947f-9d02-40e4-abee-80352a56f351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:48.558672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:48.559633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:48.560690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:48.560690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:48.560690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:48.564413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 286/573] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:48.565157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b947f-9d02-40e4-abee-80352a56f351 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.567219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afac8f-d29c-43eb-8756-0f3c6df6ed2a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:48.602739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70e22c-1490-4dc6-87ac-d3ed490f09b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:48.603366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70e22c-1490-4dc6-87ac-d3ed490f09b8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:48.603640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70e22c-1490-4dc6-87ac-d3ed490f09b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:48.603910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70e22c-1490-4dc6-87ac-d3ed490f09b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:48.614014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70e22c-1490-4dc6-87ac-d3ed490f09b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-5e70e22c-1490-4dc6-87ac-d3ed490f09b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:48.619250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:48.620190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 288/574] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:48.621351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70e22c-1490-4dc6-87ac-d3ed490f09b8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.670478 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:48.684002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b947f-9d02-40e4-abee-80352a56f351 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:48.716769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:48.720777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d5764-7a1b-440b-9229-6c40ba30f268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:48.721392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5764-7a1b-440b-9229-6c40ba30f268 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:48.721800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5764-7a1b-440b-9229-6c40ba30f268 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:48.721962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5764-7a1b-440b-9229-6c40ba30f268 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:48.722628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d5764-7a1b-440b-9229-6c40ba30f268 None admin] RBAC: Adding query filter params (name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:48.722926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d5764-7a1b-440b-9229-6c40ba30f268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:48.724295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d5764-7a1b-440b-9229-6c40ba30f268 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:48.733569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 287/575] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:48.734214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d5764-7a1b-440b-9229-6c40ba30f268 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.739752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70e22c-1490-4dc6-87ac-d3ed490f09b8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:48.777018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1e1ba-7668-44e2-b748-293398f21006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:48.777684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1e1ba-7668-44e2-b748-293398f21006 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:48.777931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1e1ba-7668-44e2-b748-293398f21006 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:48.778198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1e1ba-7668-44e2-b748-293398f21006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:48.790026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1e1ba-7668-44e2-b748-293398f21006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:48.791470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1e1ba-7668-44e2-b748-293398f21006 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-9ac1e1ba-7668-44e2-b748-293398f21006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:48.807143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:48.808263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:48.809206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:48.809206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:48.809206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:48.809206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 289/576] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:48.813661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1e1ba-7668-44e2-b748-293398f21006 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.851764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d5764-7a1b-440b-9229-6c40ba30f268 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:48.889700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa24410-3a58-436b-87e7-80cbe8901e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:48.890315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa24410-3a58-436b-87e7-80cbe8901e9c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:48.890592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa24410-3a58-436b-87e7-80cbe8901e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:48.890864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa24410-3a58-436b-87e7-80cbe8901e9c None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:48.891501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa24410-3a58-436b-87e7-80cbe8901e9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:48.891801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa24410-3a58-436b-87e7-80cbe8901e9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:48.893205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa24410-3a58-436b-87e7-80cbe8901e9c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:48.910592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 288/577] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:48.910592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa24410-3a58-436b-87e7-80cbe8901e9c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:48.923104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1e1ba-7668-44e2-b748-293398f21006 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:48.923386 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:48.957618 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68013814-9dcc-4c27-8227-4eee6848ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:48.958178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68013814-9dcc-4c27-8227-4eee6848ad17 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:48.958450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68013814-9dcc-4c27-8227-4eee6848ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:48.958720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68013814-9dcc-4c27-8227-4eee6848ad17 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:48.959380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68013814-9dcc-4c27-8227-4eee6848ad17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:48.959677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68013814-9dcc-4c27-8227-4eee6848ad17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:48.961068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68013814-9dcc-4c27-8227-4eee6848ad17 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:48.963937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:48.976601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 290/578] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:48.977449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68013814-9dcc-4c27-8227-4eee6848ad17 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.025582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa24410-3a58-436b-87e7-80cbe8901e9c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.062019 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7e13-5c99-4b2f-bfa7-90152547e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.062824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7e13-5c99-4b2f-bfa7-90152547e674 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.063102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7e13-5c99-4b2f-bfa7-90152547e674 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.063375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7e13-5c99-4b2f-bfa7-90152547e674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.075020 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a7e13-5c99-4b2f-bfa7-90152547e674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.076524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a7e13-5c99-4b2f-bfa7-90152547e674 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.082666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68013814-9dcc-4c27-8227-4eee6848ad17 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-ff7a7e13-5c99-4b2f-bfa7-90152547e674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:49.091226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:49.092171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:49.098249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:49.098249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:49.098249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:49.098249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 289/579] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:49.098249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7e13-5c99-4b2f-bfa7-90152547e674 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.126029 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3443-41b7-41c3-81b5-5206fe0a0c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.126654 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3443-41b7-41c3-81b5-5206fe0a0c07 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.126998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3443-41b7-41c3-81b5-5206fe0a0c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.127336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3443-41b7-41c3-81b5-5206fe0a0c07 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.128125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3443-41b7-41c3-81b5-5206fe0a0c07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:49.128529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3443-41b7-41c3-81b5-5206fe0a0c07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.129897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3443-41b7-41c3-81b5-5206fe0a0c07 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.141614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 291/580] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:49.142523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3443-41b7-41c3-81b5-5206fe0a0c07 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.163562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:49.204446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:49.205091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7e13-5c99-4b2f-bfa7-90152547e674 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.242865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0505bc-3c2d-4440-b03b-4d30511d90e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.243509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0505bc-3c2d-4440-b03b-4d30511d90e1 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.243791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0505bc-3c2d-4440-b03b-4d30511d90e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.244063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0505bc-3c2d-4440-b03b-4d30511d90e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.247759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3443-41b7-41c3-81b5-5206fe0a0c07 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.253609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0505bc-3c2d-4440-b03b-4d30511d90e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.254998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0505bc-3c2d-4440-b03b-4d30511d90e1 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-1a0505bc-3c2d-4440-b03b-4d30511d90e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:49.266457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:49.267547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:49.268830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:49.268830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:49.268830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:49.268830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:49.268830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:49.268830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:49.268830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:49.268830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:49.272464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 290/581] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:49.273330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0505bc-3c2d-4440-b03b-4d30511d90e1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.284783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157e57-5305-48a9-821d-45d45e255d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.285758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157e57-5305-48a9-821d-45d45e255d05 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.286190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157e57-5305-48a9-821d-45d45e255d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.286603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157e57-5305-48a9-821d-45d45e255d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.298156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b157e57-5305-48a9-821d-45d45e255d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.300193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b157e57-5305-48a9-821d-45d45e255d05 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-7b157e57-5305-48a9-821d-45d45e255d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:49.315527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:49.316799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:49.317695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:49.317695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:49.317695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:49.321842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 292/582] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:49.322484 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157e57-5305-48a9-821d-45d45e255d05 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.380407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0505bc-3c2d-4440-b03b-4d30511d90e1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.404545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:49.418512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31819ac-2143-4202-8414-2ccc87441147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.419128 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31819ac-2143-4202-8414-2ccc87441147 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.419415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31819ac-2143-4202-8414-2ccc87441147 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.419687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31819ac-2143-4202-8414-2ccc87441147 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.420334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31819ac-2143-4202-8414-2ccc87441147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:49.420739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31819ac-2143-4202-8414-2ccc87441147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.422121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31819ac-2143-4202-8414-2ccc87441147 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.429051 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157e57-5305-48a9-821d-45d45e255d05 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.434711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 291/583] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:49.435681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31819ac-2143-4202-8414-2ccc87441147 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.443040 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:49.470389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e349-2815-4131-be1f-14366845f221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.471031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e349-2815-4131-be1f-14366845f221 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.471302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e349-2815-4131-be1f-14366845f221 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.471595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e349-2815-4131-be1f-14366845f221 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.479263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10e349-2815-4131-be1f-14366845f221 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.480754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10e349-2815-4131-be1f-14366845f221 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-7d10e349-2815-4131-be1f-14366845f221 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:49.492329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:49.493508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:49.494626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 293/584] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Sep 16 19:13:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:49.499306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e349-2815-4131-be1f-14366845f221 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.545864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31819ac-2143-4202-8414-2ccc87441147 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.584363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65b15-158b-45ac-934a-370e76182f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.585096 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65b15-158b-45ac-934a-370e76182f28 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.585374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65b15-158b-45ac-934a-370e76182f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.585643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65b15-158b-45ac-934a-370e76182f28 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.586445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a65b15-158b-45ac-934a-370e76182f28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:49.586744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a65b15-158b-45ac-934a-370e76182f28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.588162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a65b15-158b-45ac-934a-370e76182f28 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.600440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e349-2815-4131-be1f-14366845f221 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.601280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 292/585] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:49.606620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65b15-158b-45ac-934a-370e76182f28 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.634975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477eee0-37fe-45d0-ad77-f2089baacb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.635644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477eee0-37fe-45d0-ad77-f2089baacb89 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.636014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477eee0-37fe-45d0-ad77-f2089baacb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.636361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477eee0-37fe-45d0-ad77-f2089baacb89 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.637096 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477eee0-37fe-45d0-ad77-f2089baacb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:49.637396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477eee0-37fe-45d0-ad77-f2089baacb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.638761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477eee0-37fe-45d0-ad77-f2089baacb89 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.655208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 294/586] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:49.655208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477eee0-37fe-45d0-ad77-f2089baacb89 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.655998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:49.684002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:49.720536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65b15-158b-45ac-934a-370e76182f28 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.759922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85952f-778f-4834-9690-42208b609b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.760614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85952f-778f-4834-9690-42208b609b3b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.760887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85952f-778f-4834-9690-42208b609b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.761139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85952f-778f-4834-9690-42208b609b3b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.769689 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85952f-778f-4834-9690-42208b609b3b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.770383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477eee0-37fe-45d0-ad77-f2089baacb89 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.771601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85952f-778f-4834-9690-42208b609b3b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-eb85952f-778f-4834-9690-42208b609b3b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:49.784088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:49.785528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:49.786619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:49.786619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:49.786619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:49.786619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:49.786619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:49.786619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:49.786619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:49.786619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:49.786619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:13:49.786619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:49.788803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 293/587] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:49.789809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85952f-778f-4834-9690-42208b609b3b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.810268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15cd08-e0c5-4ea4-8fa5-d945f5eb7b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.811122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15cd08-e0c5-4ea4-8fa5-d945f5eb7b57 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.811399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15cd08-e0c5-4ea4-8fa5-d945f5eb7b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.811669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15cd08-e0c5-4ea4-8fa5-d945f5eb7b57 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.812420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15cd08-e0c5-4ea4-8fa5-d945f5eb7b57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:49.812726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15cd08-e0c5-4ea4-8fa5-d945f5eb7b57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.814171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15cd08-e0c5-4ea4-8fa5-d945f5eb7b57 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.836932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 295/588] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Sep 16 19:13:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:49.836932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15cd08-e0c5-4ea4-8fa5-d945f5eb7b57 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.903539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85952f-778f-4834-9690-42208b609b3b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.905238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:49.925977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:49.939235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15cd08-e0c5-4ea4-8fa5-d945f5eb7b57 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:49.944341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684d984-bc93-4213-8fed-0467cd97da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.945498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684d984-bc93-4213-8fed-0467cd97da12 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.945870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684d984-bc93-4213-8fed-0467cd97da12 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.946238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684d984-bc93-4213-8fed-0467cd97da12 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/7f83a7e0c14541788c92e3d96b839077/roles/19d39213f2254bfab168b8c1148fd8db` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.963963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684d984-bc93-4213-8fed-0467cd97da12 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=7f83a7e0c14541788c92e3d96b839077, role_id=19d39213f2254bfab168b8c1148fd8db)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.966270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684d984-bc93-4213-8fed-0467cd97da12 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:49.976242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fab62-2803-40c0-94f7-aee116fe53f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:49.977265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fab62-2803-40c0-94f7-aee116fe53f1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:49.977569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fab62-2803-40c0-94f7-aee116fe53f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:49.977879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fab62-2803-40c0-94f7-aee116fe53f1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:49.982766 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 294/589] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:13:49 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/7f83a7e0c14541788c92e3d96b839077/roles/19d39213f2254bfab168b8c1148fd8db => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:49.983940 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684d984-bc93-4213-8fed-0467cd97da12 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:49.985191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fab62-2803-40c0-94f7-aee116fe53f1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:49.986674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fab62-2803-40c0-94f7-aee116fe53f1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-6f6fab62-2803-40c0-94f7-aee116fe53f1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:50.006207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:50.007386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:50.008346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 296/590] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:50.008988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fab62-2803-40c0-94f7-aee116fe53f1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:50.133682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fab62-2803-40c0-94f7-aee116fe53f1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:50.134757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684d984-bc93-4213-8fed-0467cd97da12 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:50.171239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241b6d4-c29b-4874-aab5-7a61da0d76be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:50.171815 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241b6d4-c29b-4874-aab5-7a61da0d76be None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.172077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241b6d4-c29b-4874-aab5-7a61da0d76be None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.172352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241b6d4-c29b-4874-aab5-7a61da0d76be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.176561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a98498-63c8-4674-87f2-9250a7f6b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:50.177450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a98498-63c8-4674-87f2-9250a7f6b31d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.177916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a98498-63c8-4674-87f2-9250a7f6b31d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.178346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a98498-63c8-4674-87f2-9250a7f6b31d None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.179497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a98498-63c8-4674-87f2-9250a7f6b31d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:50.179951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a98498-63c8-4674-87f2-9250a7f6b31d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:50.181624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a98498-63c8-4674-87f2-9250a7f6b31d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:50.184528 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241b6d4-c29b-4874-aab5-7a61da0d76be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:50.186001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241b6d4-c29b-4874-aab5-7a61da0d76be None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:50.197605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:50.204124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 295/591] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Sep 16 19:13:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:50.205068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a98498-63c8-4674-87f2-9250a7f6b31d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-2241b6d4-c29b-4874-aab5-7a61da0d76be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:50.206268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:50.208178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:50.209335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:50.209335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:50.209335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:50.209335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 297/592] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:50.209335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373bf9d-c4dc-49c4-9608-da9c15df5c45 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.209335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373bf9d-c4dc-49c4-9608-da9c15df5c45 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.209682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373bf9d-c4dc-49c4-9608-da9c15df5c45 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.211141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 298/593] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:50.216435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373bf9d-c4dc-49c4-9608-da9c15df5c45 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:50.221088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:50.317255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a98498-63c8-4674-87f2-9250a7f6b31d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:50.322516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373bf9d-c4dc-49c4-9608-da9c15df5c45 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:50.354258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056168bf-e20a-40a6-8d3b-569dd062e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:50.354863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056168bf-e20a-40a6-8d3b-569dd062e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.355185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056168bf-e20a-40a6-8d3b-569dd062e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.355399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056168bf-e20a-40a6-8d3b-569dd062e4a5 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.356121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056168bf-e20a-40a6-8d3b-569dd062e4a5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:50.356451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056168bf-e20a-40a6-8d3b-569dd062e4a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:50.357603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556343f6-f247-4f9c-9cca-dd61bf9dde84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:50.357874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056168bf-e20a-40a6-8d3b-569dd062e4a5 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:50.358217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556343f6-f247-4f9c-9cca-dd61bf9dde84 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.358497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556343f6-f247-4f9c-9cca-dd61bf9dde84 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.358771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556343f6-f247-4f9c-9cca-dd61bf9dde84 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.359421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556343f6-f247-4f9c-9cca-dd61bf9dde84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:50.359721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556343f6-f247-4f9c-9cca-dd61bf9dde84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:50.361113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556343f6-f247-4f9c-9cca-dd61bf9dde84 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:50.378525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 299/594] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:50.378525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9ba10-64ef-4fbd-b8b7-7a6e3df4cf73 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.378525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9ba10-64ef-4fbd-b8b7-7a6e3df4cf73 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.378525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9ba10-64ef-4fbd-b8b7-7a6e3df4cf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.381331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 296/595] 10.222.0.49 () {56 vars in 1139 bytes} [Fri Sep 16 19:13:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:50.382246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056168bf-e20a-40a6-8d3b-569dd062e4a5 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:50.397830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0de9ba10-64ef-4fbd-b8b7-7a6e3df4cf73 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:50.399292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0de9ba10-64ef-4fbd-b8b7-7a6e3df4cf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:50.450759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:50.458776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:50.471668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 300/596] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:50.472903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9ba10-64ef-4fbd-b8b7-7a6e3df4cf73 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:50.501625 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056168bf-e20a-40a6-8d3b-569dd062e4a5 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:50.549075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9786c38-9602-47ce-9e62-e3280ace30db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:50.549906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9786c38-9602-47ce-9e62-e3280ace30db None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.550283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9786c38-9602-47ce-9e62-e3280ace30db None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.550764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9786c38-9602-47ce-9e62-e3280ace30db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.562439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9786c38-9602-47ce-9e62-e3280ace30db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:50.564024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9786c38-9602-47ce-9e62-e3280ace30db None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-a9786c38-9602-47ce-9e62-e3280ace30db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:50.582557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:50.583744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:50.584902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:50.584902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:50.584902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:50.586335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 297/597] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:50.587372 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9786c38-9602-47ce-9e62-e3280ace30db None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:50.593995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9ba10-64ef-4fbd-b8b7-7a6e3df4cf73 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:50.639929 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e81a6-df2b-4255-a12d-b6a1b7dad269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:50.641034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e81a6-df2b-4255-a12d-b6a1b7dad269 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.641803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e81a6-df2b-4255-a12d-b6a1b7dad269 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.642238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e81a6-df2b-4255-a12d-b6a1b7dad269 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.651729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e81a6-df2b-4255-a12d-b6a1b7dad269 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:50.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e81a6-df2b-4255-a12d-b6a1b7dad269 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-a03e81a6-df2b-4255-a12d-b6a1b7dad269 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:50.669020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:50.670134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:50.671230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:50.671230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:50.671230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:50.671230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:50.671230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:50.671230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:50.671230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:50.671230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:50.673752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 301/598] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:50.674759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e81a6-df2b-4255-a12d-b6a1b7dad269 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:50.703547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9786c38-9602-47ce-9e62-e3280ace30db None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:50.725560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:50.742286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:50.743471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe216cd-df54-4450-adc0-5b87a02539f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:50.744234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe216cd-df54-4450-adc0-5b87a02539f3 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.744720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe216cd-df54-4450-adc0-5b87a02539f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.745087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe216cd-df54-4450-adc0-5b87a02539f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.759348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe216cd-df54-4450-adc0-5b87a02539f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:50.760946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe216cd-df54-4450-adc0-5b87a02539f3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-6fe216cd-df54-4450-adc0-5b87a02539f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:50.776457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:50.777667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:50.778540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:50.778540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:50.778540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:50.778540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 298/599] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:50.778540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe216cd-df54-4450-adc0-5b87a02539f3 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:50.802189 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e81a6-df2b-4255-a12d-b6a1b7dad269 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:50.838211 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04d7f1-38a9-44f8-b5fa-7934e7e375a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:50.838819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04d7f1-38a9-44f8-b5fa-7934e7e375a8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.839092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04d7f1-38a9-44f8-b5fa-7934e7e375a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.839360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04d7f1-38a9-44f8-b5fa-7934e7e375a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.840000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04d7f1-38a9-44f8-b5fa-7934e7e375a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:50.840297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04d7f1-38a9-44f8-b5fa-7934e7e375a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:50.841717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04d7f1-38a9-44f8-b5fa-7934e7e375a8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:50.853266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 302/600] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:50.854127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04d7f1-38a9-44f8-b5fa-7934e7e375a8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:50.890842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe216cd-df54-4450-adc0-5b87a02539f3 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:50.930110 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34db80-4858-4e81-981a-c87132e49903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:50.931003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34db80-4858-4e81-981a-c87132e49903 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:50.931439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34db80-4858-4e81-981a-c87132e49903 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:50.931852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34db80-4858-4e81-981a-c87132e49903 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:50.932829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34db80-4858-4e81-981a-c87132e49903 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:50.933274 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34db80-4858-4e81-981a-c87132e49903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:50.934963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34db80-4858-4e81-981a-c87132e49903 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:50.949946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 299/601] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:50.950818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34db80-4858-4e81-981a-c87132e49903 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:50.964453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04d7f1-38a9-44f8-b5fa-7934e7e375a8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:50.974727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:50.988072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:51.000173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fde22-04e4-4f3f-a67a-365dc130fbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.000930 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fde22-04e4-4f3f-a67a-365dc130fbcf None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.001276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fde22-04e4-4f3f-a67a-365dc130fbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.001610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fde22-04e4-4f3f-a67a-365dc130fbcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.012968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fde22-04e4-4f3f-a67a-365dc130fbcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-e88fde22-04e4-4f3f-a67a-365dc130fbcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:51.019267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:51.020238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:51.021102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 303/602] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:51.021783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fde22-04e4-4f3f-a67a-365dc130fbcf None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:51.067213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34db80-4858-4e81-981a-c87132e49903 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:51.105944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4ad00-af5a-4233-8024-598be5a5c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.107298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4ad00-af5a-4233-8024-598be5a5c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.107917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4ad00-af5a-4233-8024-598be5a5c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.108497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4ad00-af5a-4233-8024-598be5a5c0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.109324 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4ad00-af5a-4233-8024-598be5a5c0f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:51.109876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4ad00-af5a-4233-8024-598be5a5c0f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:51.111581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4ad00-af5a-4233-8024-598be5a5c0f3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:51.126481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 300/603] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:51.127342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4ad00-af5a-4233-8024-598be5a5c0f3 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:51.133899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fde22-04e4-4f3f-a67a-365dc130fbcf None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:51.171236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5e5b3-51ba-45d8-b9d4-0f717d402a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.171877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5e5b3-51ba-45d8-b9d4-0f717d402a2d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.172157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5e5b3-51ba-45d8-b9d4-0f717d402a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.172459 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5e5b3-51ba-45d8-b9d4-0f717d402a2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.180635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5e5b3-51ba-45d8-b9d4-0f717d402a2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:51.182101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5e5b3-51ba-45d8-b9d4-0f717d402a2d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-44a5e5b3-51ba-45d8-b9d4-0f717d402a2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:51.193775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:51.195046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:51.195928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:51.195928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:51.195928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:51.195928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:51.195928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:51.195928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:51.195928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:51.195928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:51.195928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 304/604] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:51.197230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5e5b3-51ba-45d8-b9d4-0f717d402a2d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:51.227730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:51.234285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:51.244152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4ad00-af5a-4233-8024-598be5a5c0f3 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:51.278683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfdcea-4b51-4f0d-9aaa-e35a03e07915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.279620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfdcea-4b51-4f0d-9aaa-e35a03e07915 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.279620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfdcea-4b51-4f0d-9aaa-e35a03e07915 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.279886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfdcea-4b51-4f0d-9aaa-e35a03e07915 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/f9988b9fef5c4d559b1918ffe040aaa8/roles/19d39213f2254bfab168b8c1148fd8db` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.294986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfdcea-4b51-4f0d-9aaa-e35a03e07915 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=f9988b9fef5c4d559b1918ffe040aaa8, role_id=19d39213f2254bfab168b8c1148fd8db)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:51.296459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfdcea-4b51-4f0d-9aaa-e35a03e07915 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:51.304112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5e5b3-51ba-45d8-b9d4-0f717d402a2d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:51.311263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 301/605] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:13:51 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/f9988b9fef5c4d559b1918ffe040aaa8/roles/19d39213f2254bfab168b8c1148fd8db => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:51.311898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfdcea-4b51-4f0d-9aaa-e35a03e07915 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:51.366064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c59aa-18c2-4a03-a9ac-960b5c1ca2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.367742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c59aa-18c2-4a03-a9ac-960b5c1ca2ab None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.368511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c59aa-18c2-4a03-a9ac-960b5c1ca2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.368967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c59aa-18c2-4a03-a9ac-960b5c1ca2ab None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.370132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c59aa-18c2-4a03-a9ac-960b5c1ca2ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:51.370625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c59aa-18c2-4a03-a9ac-960b5c1ca2ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:51.372796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c59aa-18c2-4a03-a9ac-960b5c1ca2ab None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:51.387116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 305/606] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:51.389166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c59aa-18c2-4a03-a9ac-960b5c1ca2ab None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:51.436257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfdcea-4b51-4f0d-9aaa-e35a03e07915 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:51.493509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9e7c2-8501-43fb-95f2-ce2e854da33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.494593 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e7c2-8501-43fb-95f2-ce2e854da33d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.495084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e7c2-8501-43fb-95f2-ce2e854da33d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.496119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e7c2-8501-43fb-95f2-ce2e854da33d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.507058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9e7c2-8501-43fb-95f2-ce2e854da33d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:51.509197 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9e7c2-8501-43fb-95f2-ce2e854da33d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:51.514856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:51.527584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c59aa-18c2-4a03-a9ac-960b5c1ca2ab None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-57f9e7c2-8501-43fb-95f2-ce2e854da33d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:51.527750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:51.528875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:51.529792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:51.529792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:51.529792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:51.529792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:51.529792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:51.529792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:51.529792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:51.529792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:51.529792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 302/607] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:51.529792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9e7c2-8501-43fb-95f2-ce2e854da33d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:51.540582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:51.579636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205053-8c17-4d62-b1a1-c6559ca27c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.580268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205053-8c17-4d62-b1a1-c6559ca27c3b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.580723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205053-8c17-4d62-b1a1-c6559ca27c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.581188 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205053-8c17-4d62-b1a1-c6559ca27c3b None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.582114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd205053-8c17-4d62-b1a1-c6559ca27c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:51.582224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd205053-8c17-4d62-b1a1-c6559ca27c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:51.583706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd205053-8c17-4d62-b1a1-c6559ca27c3b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:51.601419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 306/608] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:51.602339 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205053-8c17-4d62-b1a1-c6559ca27c3b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:51.648441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9e7c2-8501-43fb-95f2-ce2e854da33d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:51.685687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7183fc-022d-4cbf-acb4-f4344f30e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.686814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7183fc-022d-4cbf-acb4-f4344f30e61b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.687299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7183fc-022d-4cbf-acb4-f4344f30e61b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.687811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7183fc-022d-4cbf-acb4-f4344f30e61b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.701251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7183fc-022d-4cbf-acb4-f4344f30e61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:51.703464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7183fc-022d-4cbf-acb4-f4344f30e61b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:51.707356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205053-8c17-4d62-b1a1-c6559ca27c3b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-9f7183fc-022d-4cbf-acb4-f4344f30e61b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:51.720839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:51.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:51.722777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:51.722777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:51.722777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:51.725107 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 303/609] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:51.726225 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7183fc-022d-4cbf-acb4-f4344f30e61b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:51.743942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad9b8a-e81e-401f-a250-f9ec9daac9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.744589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad9b8a-e81e-401f-a250-f9ec9daac9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.744872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad9b8a-e81e-401f-a250-f9ec9daac9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.745146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad9b8a-e81e-401f-a250-f9ec9daac9b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.745900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad9b8a-e81e-401f-a250-f9ec9daac9b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:51.746274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad9b8a-e81e-401f-a250-f9ec9daac9b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:51.747691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad9b8a-e81e-401f-a250-f9ec9daac9b4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:51.760444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 307/610] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:51.761366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad9b8a-e81e-401f-a250-f9ec9daac9b4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:51.777567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:51.794783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:51.845926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7183fc-022d-4cbf-acb4-f4344f30e61b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:51.866902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad9b8a-e81e-401f-a250-f9ec9daac9b4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:51.884105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c7e5c-6069-449f-b529-bdfffce2e505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.885151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c7e5c-6069-449f-b529-bdfffce2e505 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.885643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c7e5c-6069-449f-b529-bdfffce2e505 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.886105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c7e5c-6069-449f-b529-bdfffce2e505 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/f932b95e90774030b003f554d9f90481/roles/19d39213f2254bfab168b8c1148fd8db` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.902118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb6199-3de1-4ba7-b63c-f26aa497a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:51.902793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb6199-3de1-4ba7-b63c-f26aa497a305 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:51.903077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb6199-3de1-4ba7-b63c-f26aa497a305 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:51.903350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb6199-3de1-4ba7-b63c-f26aa497a305 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:51.903551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c7e5c-6069-449f-b529-bdfffce2e505 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=f932b95e90774030b003f554d9f90481, role_id=19d39213f2254bfab168b8c1148fd8db)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:51.903993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb6199-3de1-4ba7-b63c-f26aa497a305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:51.904357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb6199-3de1-4ba7-b63c-f26aa497a305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:51.905654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c7e5c-6069-449f-b529-bdfffce2e505 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:51.905770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb6199-3de1-4ba7-b63c-f26aa497a305 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:51.919132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 308/611] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:51.920121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb6199-3de1-4ba7-b63c-f26aa497a305 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:51.926047 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 304/612] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:13:51 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/f932b95e90774030b003f554d9f90481/roles/19d39213f2254bfab168b8c1148fd8db => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:51.927328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c7e5c-6069-449f-b529-bdfffce2e505 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:52.030906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:52.046536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c7e5c-6069-449f-b529-bdfffce2e505 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:52.049620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:52.064552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb6199-3de1-4ba7-b63c-f26aa497a305 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:52.093454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521df9d-42cc-4ac2-9bf6-8332dd218f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:52.094545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521df9d-42cc-4ac2-9bf6-8332dd218f24 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:52.095063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521df9d-42cc-4ac2-9bf6-8332dd218f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:52.095674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521df9d-42cc-4ac2-9bf6-8332dd218f24 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:52.105758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141e819-9f56-4e45-81fd-2da062d76606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:52.106459 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141e819-9f56-4e45-81fd-2da062d76606 None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:52.106741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141e819-9f56-4e45-81fd-2da062d76606 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:52.107019 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141e819-9f56-4e45-81fd-2da062d76606 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/32ca32d96f9a436782ef0680f6b5dcac/roles/19d39213f2254bfab168b8c1148fd8db` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:52.107290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521df9d-42cc-4ac2-9bf6-8332dd218f24 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:52.109287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521df9d-42cc-4ac2-9bf6-8332dd218f24 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-8521df9d-42cc-4ac2-9bf6-8332dd218f24 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:52.123746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:52.124810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:52.125763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:52.125763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:52.125763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:52.125763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:52.125763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:52.125763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:52.125763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:52.125763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:52.125763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:13:52.125763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:52.126311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 305/613] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:13:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:52.127569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141e819-9f56-4e45-81fd-2da062d76606 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=32ca32d96f9a436782ef0680f6b5dcac, role_id=19d39213f2254bfab168b8c1148fd8db)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:52.132421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141e819-9f56-4e45-81fd-2da062d76606 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:52.132675 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521df9d-42cc-4ac2-9bf6-8332dd218f24 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:52.153281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 309/614] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:13:51 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/32ca32d96f9a436782ef0680f6b5dcac/roles/19d39213f2254bfab168b8c1148fd8db => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:52.212406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469d3d3-6219-4b36-95e6-b823b0d6aa87 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:52.212731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469d3d3-6219-4b36-95e6-b823b0d6aa87 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:52.212975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469d3d3-6219-4b36-95e6-b823b0d6aa87 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:52.214657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 310/615] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:13:52.220541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab97d58-d370-4857-ae1c-55654d987ad9 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:52.220871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab97d58-d370-4857-ae1c-55654d987ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:52.221087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab97d58-d370-4857-ae1c-55654d987ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:52.241437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-eab97d58-d370-4857-ae1c-55654d987ad9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:52.242636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-eab97d58-d370-4857-ae1c-55654d987ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:52.282376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521df9d-42cc-4ac2-9bf6-8332dd218f24 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:52.329111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d50f6-ad73-4826-9ca0-b6ef8561e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:52.330115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d50f6-ad73-4826-9ca0-b6ef8561e758 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:52.330443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 311/616] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:52.330995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d50f6-ad73-4826-9ca0-b6ef8561e758 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:52.331488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d50f6-ad73-4826-9ca0-b6ef8561e758 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:52.332682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d50f6-ad73-4826-9ca0-b6ef8561e758 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:52.333185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d50f6-ad73-4826-9ca0-b6ef8561e758 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:52.334810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d50f6-ad73-4826-9ca0-b6ef8561e758 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:52.362613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 306/617] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Sep 16 19:13:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:52.368774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab97d58-d370-4857-ae1c-55654d987ad9 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:52.447783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:52.500672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab97d58-d370-4857-ae1c-55654d987ad9 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:52.537584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6205fc3-8edf-4c35-980f-f11c2bf9e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:52.538146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6205fc3-8edf-4c35-980f-f11c2bf9e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:52.538419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6205fc3-8edf-4c35-980f-f11c2bf9e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:52.538688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6205fc3-8edf-4c35-980f-f11c2bf9e5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:52.550249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6205fc3-8edf-4c35-980f-f11c2bf9e5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:52.551717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6205fc3-8edf-4c35-980f-f11c2bf9e5c6 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-d6205fc3-8edf-4c35-980f-f11c2bf9e5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:52.567715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:52.568745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:52.569987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:52.569987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:52.569987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:52.569987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 312/618] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:52.574918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d50f6-ad73-4826-9ca0-b6ef8561e758 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:52.619190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:52.648491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6205fc3-8edf-4c35-980f-f11c2bf9e5c6 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:52.756540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d50f6-ad73-4826-9ca0-b6ef8561e758 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:52.815669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbffe8-8aee-4c68-adce-acc75ca7d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:52.816208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbffe8-8aee-4c68-adce-acc75ca7d974 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:52.817064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbffe8-8aee-4c68-adce-acc75ca7d974 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:52.817344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbffe8-8aee-4c68-adce-acc75ca7d974 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:52.818001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbffe8-8aee-4c68-adce-acc75ca7d974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:52.818305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbffe8-8aee-4c68-adce-acc75ca7d974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:52.820047 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbffe8-8aee-4c68-adce-acc75ca7d974 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:52.833128 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 307/619] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:52.838175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbffe8-8aee-4c68-adce-acc75ca7d974 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:52.854323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6205fc3-8edf-4c35-980f-f11c2bf9e5c6 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:52.857268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:52.902210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645521b-c1c0-42fa-836d-509f2680be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:52.902872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645521b-c1c0-42fa-836d-509f2680be4a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:52.903143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645521b-c1c0-42fa-836d-509f2680be4a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:52.903413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645521b-c1c0-42fa-836d-509f2680be4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:52.931294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645521b-c1c0-42fa-836d-509f2680be4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-8645521b-c1c0-42fa-836d-509f2680be4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:52.938915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:52.939863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:52.940770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:52.948472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 313/620] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:52.961765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645521b-c1c0-42fa-836d-509f2680be4a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:53.018623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:53.054533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbffe8-8aee-4c68-adce-acc75ca7d974 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:53.127075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d97720-0e20-44e8-8afb-a7bf296f347c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:53.129102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d97720-0e20-44e8-8afb-a7bf296f347c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:53.129391 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d97720-0e20-44e8-8afb-a7bf296f347c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:53.129667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d97720-0e20-44e8-8afb-a7bf296f347c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:53.136723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645521b-c1c0-42fa-836d-509f2680be4a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:53.144660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d97720-0e20-44e8-8afb-a7bf296f347c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:53.146167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d97720-0e20-44e8-8afb-a7bf296f347c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-45d97720-0e20-44e8-8afb-a7bf296f347c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:53.174366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:53.175352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:53.176239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:53.176239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:53.176239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:53.176239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:53.176239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:53.176239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:53.176239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:53.176239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:53.176239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 308/621] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:53.181443 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d97720-0e20-44e8-8afb-a7bf296f347c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:53.225113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a08be-6d88-4228-baee-6919151a74e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:53.225749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a08be-6d88-4228-baee-6919151a74e2 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:53.226034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a08be-6d88-4228-baee-6919151a74e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:53.226313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a08be-6d88-4228-baee-6919151a74e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:53.227003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a08be-6d88-4228-baee-6919151a74e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:53.227311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a08be-6d88-4228-baee-6919151a74e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:53.228725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a08be-6d88-4228-baee-6919151a74e2 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:53.244101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 314/622] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:53.249347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a08be-6d88-4228-baee-6919151a74e2 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:53.292745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d97720-0e20-44e8-8afb-a7bf296f347c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:53.312889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:53.364099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11840f-f7da-4a7a-99ab-51f7a106029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:53.364806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11840f-f7da-4a7a-99ab-51f7a106029c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:53.365091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11840f-f7da-4a7a-99ab-51f7a106029c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:53.365364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11840f-f7da-4a7a-99ab-51f7a106029c None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:53.366077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11840f-f7da-4a7a-99ab-51f7a106029c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:53.366382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11840f-f7da-4a7a-99ab-51f7a106029c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:53.367814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11840f-f7da-4a7a-99ab-51f7a106029c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:53.388128 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a08be-6d88-4228-baee-6919151a74e2 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:53.399640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 309/623] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:53.418283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11840f-f7da-4a7a-99ab-51f7a106029c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:53.428434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:53.429517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213a1e-92ca-4da6-9e26-8e968957b648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:53.430159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213a1e-92ca-4da6-9e26-8e968957b648 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:53.430442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213a1e-92ca-4da6-9e26-8e968957b648 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:53.430719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213a1e-92ca-4da6-9e26-8e968957b648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:53.443409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40213a1e-92ca-4da6-9e26-8e968957b648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:53.445364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40213a1e-92ca-4da6-9e26-8e968957b648 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-40213a1e-92ca-4da6-9e26-8e968957b648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:53.460753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:53.461733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:53.462635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:53.462635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:53.462635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:53.462635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 315/624] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:53.469891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213a1e-92ca-4da6-9e26-8e968957b648 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:53.566764 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:53.591047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213a1e-92ca-4da6-9e26-8e968957b648 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:53.626089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca3df-b17b-4713-83d7-8654c71c8d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:53.626769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca3df-b17b-4713-83d7-8654c71c8d78 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:53.627052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca3df-b17b-4713-83d7-8654c71c8d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:53.627346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca3df-b17b-4713-83d7-8654c71c8d78 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:53.632406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fca3df-b17b-4713-83d7-8654c71c8d78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:53.632406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fca3df-b17b-4713-83d7-8654c71c8d78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:53.632406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fca3df-b17b-4713-83d7-8654c71c8d78 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:53.642484 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 316/625] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:53.648821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca3df-b17b-4713-83d7-8654c71c8d78 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:53.651041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11840f-f7da-4a7a-99ab-51f7a106029c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:53.690165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476027bf-c191-4c66-8fd9-bd9a1fe41d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:53.690571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476027bf-c191-4c66-8fd9-bd9a1fe41d8f None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:53.690851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476027bf-c191-4c66-8fd9-bd9a1fe41d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:53.691126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476027bf-c191-4c66-8fd9-bd9a1fe41d8f None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/94828db5fc064a539b5b7b17cac1602b/roles/19d39213f2254bfab168b8c1148fd8db` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:53.708461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476027bf-c191-4c66-8fd9-bd9a1fe41d8f None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=94828db5fc064a539b5b7b17cac1602b, role_id=19d39213f2254bfab168b8c1148fd8db)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:53.710432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476027bf-c191-4c66-8fd9-bd9a1fe41d8f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:53.732295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 310/626] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:13:53 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/94828db5fc064a539b5b7b17cac1602b/roles/19d39213f2254bfab168b8c1148fd8db => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:13:53.817513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca3df-b17b-4713-83d7-8654c71c8d78 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:53.862468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d4dbb-c6f6-435e-887d-2509ae01c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:53.863216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4dbb-c6f6-435e-887d-2509ae01c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:53.863489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4dbb-c6f6-435e-887d-2509ae01c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:53.863755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4dbb-c6f6-435e-887d-2509ae01c7d3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:53.874205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d4dbb-c6f6-435e-887d-2509ae01c7d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:53.875792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d4dbb-c6f6-435e-887d-2509ae01c7d3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:53.880911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-064d4dbb-c6f6-435e-887d-2509ae01c7d3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:53.894955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:53.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:53.896953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 317/627] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:53.902526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476027bf-c191-4c66-8fd9-bd9a1fe41d8f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:53.978985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:54.016542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a61e98-58f6-4f9c-8bf0-62b9b00356d1 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.017841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a61e98-58f6-4f9c-8bf0-62b9b00356d1 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.018765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a61e98-58f6-4f9c-8bf0-62b9b00356d1 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.022083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 318/628] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:54.029724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640aa3-b831-4958-95a9-2604b17bd49e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.030050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640aa3-b831-4958-95a9-2604b17bd49e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.030272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640aa3-b831-4958-95a9-2604b17bd49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.039576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476027bf-c191-4c66-8fd9-bd9a1fe41d8f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:54.050166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-e9640aa3-b831-4958-95a9-2604b17bd49e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:54.051382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e9640aa3-b831-4958-95a9-2604b17bd49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:54.082438 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db7326-f037-4c0e-844f-197ad0e7a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:54.083539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7326-f037-4c0e-844f-197ad0e7a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.083826 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7326-f037-4c0e-844f-197ad0e7a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.084363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7326-f037-4c0e-844f-197ad0e7a9a3 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.085221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db7326-f037-4c0e-844f-197ad0e7a9a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:54.085523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db7326-f037-4c0e-844f-197ad0e7a9a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:54.087044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db7326-f037-4c0e-844f-197ad0e7a9a3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:54.112518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 311/629] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Sep 16 19:13:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:54.115501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db7326-f037-4c0e-844f-197ad0e7a9a3 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:54.128563 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 319/630] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:13:54.222313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db7326-f037-4c0e-844f-197ad0e7a9a3 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:54.234698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:54.259221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9b8a1-78ad-48ea-a369-d72b4d2afd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:54.259882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9b8a1-78ad-48ea-a369-d72b4d2afd70 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.260159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9b8a1-78ad-48ea-a369-d72b4d2afd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.260448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9b8a1-78ad-48ea-a369-d72b4d2afd70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.335339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9b8a1-78ad-48ea-a369-d72b4d2afd70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:54.336890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9b8a1-78ad-48ea-a369-d72b4d2afd70 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:54.437897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 312/631] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:13:54.443506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640aa3-b831-4958-95a9-2604b17bd49e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:54.485358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9b8a1-78ad-48ea-a369-d72b4d2afd70 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:54.501214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:54.561957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640aa3-b831-4958-95a9-2604b17bd49e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:54.618525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:54.631999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bf2fa-64ed-4b3a-94f0-d9deaa37a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:54.633186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bf2fa-64ed-4b3a-94f0-d9deaa37a0ef None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.633657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bf2fa-64ed-4b3a-94f0-d9deaa37a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.634114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bf2fa-64ed-4b3a-94f0-d9deaa37a0ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.643542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9b8a1-78ad-48ea-a369-d72b4d2afd70 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:54.661537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bf2fa-64ed-4b3a-94f0-d9deaa37a0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:54.663046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bf2fa-64ed-4b3a-94f0-d9deaa37a0ef None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:54.682046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d8b09-9108-4f13-ac61-642a64c8e79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:54.682704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8b09-9108-4f13-ac61-642a64c8e79d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.682954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8b09-9108-4f13-ac61-642a64c8e79d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.683221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8b09-9108-4f13-ac61-642a64c8e79d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-515bf2fa-64ed-4b3a-94f0-d9deaa37a0ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:54.688492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:54.689403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:54.690750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:54.690750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:54.690750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:54.690750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 320/632] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:54.695799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bf2fa-64ed-4b3a-94f0-d9deaa37a0ef None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:54.696901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d8b09-9108-4f13-ac61-642a64c8e79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-b13d8b09-9108-4f13-ac61-642a64c8e79d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:54.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:54.703034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:54.704065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 313/633] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:13:54.710820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc95d2-2fb8-4d66-9a79-11c0ada169e9 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.711375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc95d2-2fb8-4d66-9a79-11c0ada169e9 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.711585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc95d2-2fb8-4d66-9a79-11c0ada169e9 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.713377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 314/634] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:13:54.718098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc95d2-2fb8-4d66-9a79-11c0ada169e9 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:54.793213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:54.809668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bf2fa-64ed-4b3a-94f0-d9deaa37a0ef None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:54.830704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc95d2-2fb8-4d66-9a79-11c0ada169e9 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:54.844619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933da62-66f2-46fc-b55f-61c2f1295a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:54.845298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933da62-66f2-46fc-b55f-61c2f1295a80 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.845553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933da62-66f2-46fc-b55f-61c2f1295a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.845820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933da62-66f2-46fc-b55f-61c2f1295a80 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.846505 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933da62-66f2-46fc-b55f-61c2f1295a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:54.846801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933da62-66f2-46fc-b55f-61c2f1295a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:54.848173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933da62-66f2-46fc-b55f-61c2f1295a80 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:54.865177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 321/635] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:13:54.865177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf003eb-e2c9-4083-926f-42fd6a0806ef None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.865177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf003eb-e2c9-4083-926f-42fd6a0806ef None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.865177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf003eb-e2c9-4083-926f-42fd6a0806ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.870931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ae28b-9e63-47af-8cb7-330cdf29a97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:54.871540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ae28b-9e63-47af-8cb7-330cdf29a97e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.871822 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ae28b-9e63-47af-8cb7-330cdf29a97e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.872095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ae28b-9e63-47af-8cb7-330cdf29a97e None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.872803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ae28b-9e63-47af-8cb7-330cdf29a97e None admin] RBAC: Adding query filter params (name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:54.873109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ae28b-9e63-47af-8cb7-330cdf29a97e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:54.874484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ae28b-9e63-47af-8cb7-330cdf29a97e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:54.881328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ecf003eb-e2c9-4083-926f-42fd6a0806ef None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:54.882462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ecf003eb-e2c9-4083-926f-42fd6a0806ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:54.887987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 315/636] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:54.887987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6a04-a0f3-4023-851c-0cd1ce65105f None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:54.887987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6a04-a0f3-4023-851c-0cd1ce65105f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:54.887987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6a04-a0f3-4023-851c-0cd1ce65105f None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:54.890495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 316/637] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:54.891149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6a04-a0f3-4023-851c-0cd1ce65105f None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:54.923846 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:54.961625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 322/638] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:54.962473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf003eb-e2c9-4083-926f-42fd6a0806ef None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:55.016744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6a04-a0f3-4023-851c-0cd1ce65105f None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:55.058477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:55.066535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561703b-3704-4c53-9c72-2ef608073bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:55.067419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561703b-3704-4c53-9c72-2ef608073bae None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.067902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561703b-3704-4c53-9c72-2ef608073bae None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.068247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf003eb-e2c9-4083-926f-42fd6a0806ef None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:55.068577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561703b-3704-4c53-9c72-2ef608073bae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.077921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561703b-3704-4c53-9c72-2ef608073bae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:55.080514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561703b-3704-4c53-9c72-2ef608073bae None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-1561703b-3704-4c53-9c72-2ef608073bae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:55.092368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:55.093321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:55.094216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:55.094216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:55.094216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:55.094216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:55.094216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:55.094216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:55.094216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:55.094216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:55.098430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 317/639] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:55.099778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20897ae-723e-4503-beb8-870e816dfaf7 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.100109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20897ae-723e-4503-beb8-870e816dfaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.100372 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20897ae-723e-4503-beb8-870e816dfaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.111306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda78e-388b-4736-9e5b-90824b504c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:55.112034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda78e-388b-4736-9e5b-90824b504c66 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.112310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda78e-388b-4736-9e5b-90824b504c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.112651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda78e-388b-4736-9e5b-90824b504c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.122877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-a20897ae-723e-4503-beb8-870e816dfaf7 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:55.123879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deda78e-388b-4736-9e5b-90824b504c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:55.124567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a20897ae-723e-4503-beb8-870e816dfaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:55.125631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deda78e-388b-4736-9e5b-90824b504c66 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-9deda78e-388b-4736-9e5b-90824b504c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:55.141245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:55.142328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:55.143300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:55.143300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:55.143300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:55.147914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 323/640] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:55.148686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda78e-388b-4736-9e5b-90824b504c66 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:55.173688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:55.214460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 318/641] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:55.216214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20897ae-723e-4503-beb8-870e816dfaf7 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:55.260998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda78e-388b-4736-9e5b-90824b504c66 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:55.294457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f45cc-a13c-4172-958f-68d3b8eccb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:55.295206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f45cc-a13c-4172-958f-68d3b8eccb0d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.295552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f45cc-a13c-4172-958f-68d3b8eccb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.295965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f45cc-a13c-4172-958f-68d3b8eccb0d None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.296748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f45cc-a13c-4172-958f-68d3b8eccb0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:55.297041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f45cc-a13c-4172-958f-68d3b8eccb0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:55.298589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f45cc-a13c-4172-958f-68d3b8eccb0d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:55.311488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 324/642] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:55.316975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f45cc-a13c-4172-958f-68d3b8eccb0d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:55.342806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20897ae-723e-4503-beb8-870e816dfaf7 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:55.371947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:55.387292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613798b1-fae7-43c3-8e36-3f5dc3df2d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:55.388619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613798b1-fae7-43c3-8e36-3f5dc3df2d97 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.389109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613798b1-fae7-43c3-8e36-3f5dc3df2d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.389555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613798b1-fae7-43c3-8e36-3f5dc3df2d97 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.390649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613798b1-fae7-43c3-8e36-3f5dc3df2d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:55.392048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613798b1-fae7-43c3-8e36-3f5dc3df2d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:55.394062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613798b1-fae7-43c3-8e36-3f5dc3df2d97 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:55.406671 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:55.410370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 319/643] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:55.416173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613798b1-fae7-43c3-8e36-3f5dc3df2d97 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:55.428501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f45cc-a13c-4172-958f-68d3b8eccb0d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:55.478975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40932d4-f759-4c67-b038-43fa8426c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:55.480569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40932d4-f759-4c67-b038-43fa8426c76b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.481418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40932d4-f759-4c67-b038-43fa8426c76b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.481837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40932d4-f759-4c67-b038-43fa8426c76b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.496197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40932d4-f759-4c67-b038-43fa8426c76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-b40932d4-f759-4c67-b038-43fa8426c76b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:55.502933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:55.503950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:55.504902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 325/644] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:55.505602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40932d4-f759-4c67-b038-43fa8426c76b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:55.528044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613798b1-fae7-43c3-8e36-3f5dc3df2d97 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:55.563014 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badb6f5-6400-4637-9c57-983a8a7ab832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:55.563542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badb6f5-6400-4637-9c57-983a8a7ab832 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.563820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badb6f5-6400-4637-9c57-983a8a7ab832 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.564099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badb6f5-6400-4637-9c57-983a8a7ab832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.564951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badb6f5-6400-4637-9c57-983a8a7ab832 None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=7f83a7e0c14541788c92e3d96b839077) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:55.565266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badb6f5-6400-4637-9c57-983a8a7ab832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:55.566710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badb6f5-6400-4637-9c57-983a8a7ab832 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:55.573347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 320/645] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:55 2022] GET /identity/v3/role_assignments?user.id=7f83a7e0c14541788c92e3d96b839077&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:55.574141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badb6f5-6400-4637-9c57-983a8a7ab832 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:55.627806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40932d4-f759-4c67-b038-43fa8426c76b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:55.634707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:55.671757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a834-5fce-4cb5-8fc4-2d8ca3b283b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:55.672882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a834-5fce-4cb5-8fc4-2d8ca3b283b2 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.673356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a834-5fce-4cb5-8fc4-2d8ca3b283b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.673825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a834-5fce-4cb5-8fc4-2d8ca3b283b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.682816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2a834-5fce-4cb5-8fc4-2d8ca3b283b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:55.684698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2a834-5fce-4cb5-8fc4-2d8ca3b283b2 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-9ca2a834-5fce-4cb5-8fc4-2d8ca3b283b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:55.697897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:55.698917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:55.700009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:55.700009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:55.700009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:55.700009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:55.700009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:55.700009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:55.700009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:55.700009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:55.700009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:13:55.700009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:55.707556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 326/646] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Sep 16 19:13:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:55.708694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badb6f5-6400-4637-9c57-983a8a7ab832 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:55.709534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a834-5fce-4cb5-8fc4-2d8ca3b283b2 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:55.712803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:55.761235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c61e0-3e41-444b-a632-3498191936ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:55.761911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c61e0-3e41-444b-a632-3498191936ee None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.762209 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c61e0-3e41-444b-a632-3498191936ee None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.767703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c61e0-3e41-444b-a632-3498191936ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.781211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c61e0-3e41-444b-a632-3498191936ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-489c61e0-3e41-444b-a632-3498191936ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:55.787794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:55.788776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:55.789615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:55.793948 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 321/647] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:55.794803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c61e0-3e41-444b-a632-3498191936ee None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:55.834698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a834-5fce-4cb5-8fc4-2d8ca3b283b2 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:55.873463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a95b33-9f62-4aba-bedf-2e301e493c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:55.874070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a95b33-9f62-4aba-bedf-2e301e493c31 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.874344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a95b33-9f62-4aba-bedf-2e301e493c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.874611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a95b33-9f62-4aba-bedf-2e301e493c31 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.875271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a95b33-9f62-4aba-bedf-2e301e493c31 None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:55.875567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a95b33-9f62-4aba-bedf-2e301e493c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:55.876970 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a95b33-9f62-4aba-bedf-2e301e493c31 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:55.890726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 327/648] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:55.890726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a95b33-9f62-4aba-bedf-2e301e493c31 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:55.934385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c61e0-3e41-444b-a632-3498191936ee None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:55.943003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:55.962814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:55.976136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068289-23d1-45de-a330-10cb3f3abf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:55.976794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068289-23d1-45de-a330-10cb3f3abf89 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:55.977076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068289-23d1-45de-a330-10cb3f3abf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:55.977351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068289-23d1-45de-a330-10cb3f3abf89 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:55.978096 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51068289-23d1-45de-a330-10cb3f3abf89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:55.978404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51068289-23d1-45de-a330-10cb3f3abf89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:55.979916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51068289-23d1-45de-a330-10cb3f3abf89 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:56.005895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 322/649] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Sep 16 19:13:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:56.010640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068289-23d1-45de-a330-10cb3f3abf89 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:56.019594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a95b33-9f62-4aba-bedf-2e301e493c31 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:56.067943 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a8f04-b78e-4f46-ad2b-216d701e60de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:56.068970 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a8f04-b78e-4f46-ad2b-216d701e60de None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.069806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a8f04-b78e-4f46-ad2b-216d701e60de None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.070828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a8f04-b78e-4f46-ad2b-216d701e60de None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.071958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a8f04-b78e-4f46-ad2b-216d701e60de None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:56.072503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a8f04-b78e-4f46-ad2b-216d701e60de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:56.074891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a8f04-b78e-4f46-ad2b-216d701e60de None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:56.086830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 328/650] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:56.087940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a8f04-b78e-4f46-ad2b-216d701e60de None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:56.133266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068289-23d1-45de-a330-10cb3f3abf89 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:56.175764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcd93b-e5e4-4550-8dbc-76d6b063967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:56.176710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcd93b-e5e4-4550-8dbc-76d6b063967b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.177560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcd93b-e5e4-4550-8dbc-76d6b063967b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.177976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcd93b-e5e4-4550-8dbc-76d6b063967b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.191687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcd93b-e5e4-4550-8dbc-76d6b063967b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:56.193513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcd93b-e5e4-4550-8dbc-76d6b063967b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:56.201514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a8f04-b78e-4f46-ad2b-216d701e60de None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-5cfcd93b-e5e4-4550-8dbc-76d6b063967b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:56.213825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:56.214849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:56.215734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:56.215734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:56.215734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:56.219632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 323/651] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:56.220542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcd93b-e5e4-4550-8dbc-76d6b063967b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:56.232609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:56.240082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:56.257357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02a8d1-657e-4e3b-8a19-65ec0e87edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:56.258987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02a8d1-657e-4e3b-8a19-65ec0e87edf8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.259379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02a8d1-657e-4e3b-8a19-65ec0e87edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.259777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02a8d1-657e-4e3b-8a19-65ec0e87edf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.340610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcd93b-e5e4-4550-8dbc-76d6b063967b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:56.357231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02a8d1-657e-4e3b-8a19-65ec0e87edf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:56.359499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02a8d1-657e-4e3b-8a19-65ec0e87edf8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:56.375753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d197e8f-fab5-468f-af85-30e7903a165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:56.376461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d197e8f-fab5-468f-af85-30e7903a165f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.376756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d197e8f-fab5-468f-af85-30e7903a165f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.377017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d197e8f-fab5-468f-af85-30e7903a165f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.394884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d197e8f-fab5-468f-af85-30e7903a165f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:56.396496 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d197e8f-fab5-468f-af85-30e7903a165f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-8d197e8f-fab5-468f-af85-30e7903a165f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:56.412969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:56.413988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:56.414870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:56.414870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:56.414870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:56.418905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 324/652] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:56.419791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d197e8f-fab5-468f-af85-30e7903a165f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:56.482138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 329/653] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:56.489667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02a8d1-657e-4e3b-8a19-65ec0e87edf8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:56.500765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:56.520586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:56.523584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d197e8f-fab5-468f-af85-30e7903a165f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:56.558328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba8f90-07ea-42a3-a3c3-73e41b6765f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:56.558947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba8f90-07ea-42a3-a3c3-73e41b6765f2 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.559228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba8f90-07ea-42a3-a3c3-73e41b6765f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.559503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba8f90-07ea-42a3-a3c3-73e41b6765f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.560144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba8f90-07ea-42a3-a3c3-73e41b6765f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:56.560547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba8f90-07ea-42a3-a3c3-73e41b6765f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:56.561949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba8f90-07ea-42a3-a3c3-73e41b6765f2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:56.578429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 325/654] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:56.578429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba8f90-07ea-42a3-a3c3-73e41b6765f2 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:56.602570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02a8d1-657e-4e3b-8a19-65ec0e87edf8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:56.641096 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafda976-2ce6-4035-8fc0-6e75cf1c79f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:56.641715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafda976-2ce6-4035-8fc0-6e75cf1c79f0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.641988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafda976-2ce6-4035-8fc0-6e75cf1c79f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.642254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafda976-2ce6-4035-8fc0-6e75cf1c79f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.643049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafda976-2ce6-4035-8fc0-6e75cf1c79f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:56.643347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafda976-2ce6-4035-8fc0-6e75cf1c79f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:56.645116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafda976-2ce6-4035-8fc0-6e75cf1c79f0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:56.658232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 330/655] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:56.659715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9267e0-551e-4921-9207-0296e54672f0 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.659993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9267e0-551e-4921-9207-0296e54672f0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.660262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9267e0-551e-4921-9207-0296e54672f0 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.664433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 331/656] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:56.664433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9267e0-551e-4921-9207-0296e54672f0 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:56.692603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba8f90-07ea-42a3-a3c3-73e41b6765f2 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:56.721030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:56.730628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b5a29-6f3f-4ace-ab87-ce4e77dce2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:56.731275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b5a29-6f3f-4ace-ab87-ce4e77dce2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.731556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b5a29-6f3f-4ace-ab87-ce4e77dce2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.731832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b5a29-6f3f-4ace-ab87-ce4e77dce2d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.742966 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b5a29-6f3f-4ace-ab87-ce4e77dce2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:56.744428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b5a29-6f3f-4ace-ab87-ce4e77dce2d8 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:56.758391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-0e7b5a29-6f3f-4ace-ab87-ce4e77dce2d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:56.762413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:56.763705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:56.764697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:56.764697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:56.764697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:56.768699 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 326/657] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:56.769601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b5a29-6f3f-4ace-ab87-ce4e77dce2d8 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:56.779532 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9267e0-551e-4921-9207-0296e54672f0 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:56.815401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669474f-b4ee-4112-b284-96bfc072cea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:56.816332 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669474f-b4ee-4112-b284-96bfc072cea7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.816825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669474f-b4ee-4112-b284-96bfc072cea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.817229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669474f-b4ee-4112-b284-96bfc072cea7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.825751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669474f-b4ee-4112-b284-96bfc072cea7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:56.827429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669474f-b4ee-4112-b284-96bfc072cea7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-b669474f-b4ee-4112-b284-96bfc072cea7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:56.838984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:56.840025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:56.841070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:56.841070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:56.841070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:56.841070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:56.841070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:56.841070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:56.841070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:56.841070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:56.841070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:13:56.841070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:56.841605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 332/658] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:13:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:56.842683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecf2e9-15a1-4ffd-9ce9-a1bd20ced698 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.842964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecf2e9-15a1-4ffd-9ce9-a1bd20ced698 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.843236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecf2e9-15a1-4ffd-9ce9-a1bd20ced698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.862025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d1ecf2e9-15a1-4ffd-9ce9-a1bd20ced698 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:56.863298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d1ecf2e9-15a1-4ffd-9ce9-a1bd20ced698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:56.883097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b5a29-6f3f-4ace-ab87-ce4e77dce2d8 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:56.922732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25605ece-db74-49fc-abd4-190246f71a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:56.923369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25605ece-db74-49fc-abd4-190246f71a5d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:56.923710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25605ece-db74-49fc-abd4-190246f71a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:56.923912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25605ece-db74-49fc-abd4-190246f71a5d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:56.931745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25605ece-db74-49fc-abd4-190246f71a5d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:56.940445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 333/659] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:56.940606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25605ece-db74-49fc-abd4-190246f71a5d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:56.940715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecf2e9-15a1-4ffd-9ce9-a1bd20ced698 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-25605ece-db74-49fc-abd4-190246f71a5d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:56.953416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:56.954484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:56.955642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 327/660] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:56.956293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25605ece-db74-49fc-abd4-190246f71a5d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:57.001991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:57.033022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:57.059465 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecf2e9-15a1-4ffd-9ce9-a1bd20ced698 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:57.071255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25605ece-db74-49fc-abd4-190246f71a5d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:57.098438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af9319-680d-4cc0-adc8-8121203d1a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:57.099060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af9319-680d-4cc0-adc8-8121203d1a63 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:57.099334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af9319-680d-4cc0-adc8-8121203d1a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:57.099605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af9319-680d-4cc0-adc8-8121203d1a63 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:57.100249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af9319-680d-4cc0-adc8-8121203d1a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:57.100706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af9319-680d-4cc0-adc8-8121203d1a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:57.102195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af9319-680d-4cc0-adc8-8121203d1a63 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:57.114239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03aef-341b-449e-8124-a9b3b3135a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:57.114881 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 334/661] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:57.115216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03aef-341b-449e-8124-a9b3b3135a28 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:57.115637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03aef-341b-449e-8124-a9b3b3135a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:57.115838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af9319-680d-4cc0-adc8-8121203d1a63 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:57.116283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03aef-341b-449e-8124-a9b3b3135a28 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:57.117208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03aef-341b-449e-8124-a9b3b3135a28 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:57.117655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03aef-341b-449e-8124-a9b3b3135a28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:57.120870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03aef-341b-449e-8124-a9b3b3135a28 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:57.150467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 328/662] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Sep 16 19:13:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:57.151363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03aef-341b-449e-8124-a9b3b3135a28 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:57.246988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af9319-680d-4cc0-adc8-8121203d1a63 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:57.262018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:57.265932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03aef-341b-449e-8124-a9b3b3135a28 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:57.289187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61375b-6d5a-48eb-917a-dbe7a00acbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:57.290039 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61375b-6d5a-48eb-917a-dbe7a00acbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:57.290309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61375b-6d5a-48eb-917a-dbe7a00acbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:57.290580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61375b-6d5a-48eb-917a-dbe7a00acbe9 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:57.291303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61375b-6d5a-48eb-917a-dbe7a00acbe9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:57.291605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61375b-6d5a-48eb-917a-dbe7a00acbe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:57.293078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61375b-6d5a-48eb-917a-dbe7a00acbe9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:57.296700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:57.304417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d0982-71c3-463f-814d-7868cadd7a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:57.305392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d0982-71c3-463f-814d-7868cadd7a8e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:57.305392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d0982-71c3-463f-814d-7868cadd7a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:57.305624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d0982-71c3-463f-814d-7868cadd7a8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:57.312580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d0982-71c3-463f-814d-7868cadd7a8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:57.318334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 335/663] 10.222.0.49 () {56 vars in 1139 bytes} [Fri Sep 16 19:13:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:57.318475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d0982-71c3-463f-814d-7868cadd7a8e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:57.318555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61375b-6d5a-48eb-917a-dbe7a00acbe9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-236d0982-71c3-463f-814d-7868cadd7a8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:57.331154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:57.332253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:57.333578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:57.333578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:57.333578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:57.333578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:57.333578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:57.333578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:57.333578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:57.333578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:57.333578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 329/664] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:57.333578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d0982-71c3-463f-814d-7868cadd7a8e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:57.433816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61375b-6d5a-48eb-917a-dbe7a00acbe9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:57.437990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d0982-71c3-463f-814d-7868cadd7a8e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:57.470033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab72611-c1dd-4b52-bbb4-bd82716a1e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:57.470650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72611-c1dd-4b52-bbb4-bd82716a1e10 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:57.470961 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72611-c1dd-4b52-bbb4-bd82716a1e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:57.471236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72611-c1dd-4b52-bbb4-bd82716a1e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:57.473791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a0e3-5143-4aaf-9d2a-a32ad071646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:57.474427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a0e3-5143-4aaf-9d2a-a32ad071646b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:57.474699 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a0e3-5143-4aaf-9d2a-a32ad071646b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:57.474972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a0e3-5143-4aaf-9d2a-a32ad071646b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:57.485556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a0e3-5143-4aaf-9d2a-a32ad071646b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-d272a0e3-5143-4aaf-9d2a-a32ad071646b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:13:57.491024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:57.491982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:57.493470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 330/665] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:13:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:57.497752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a0e3-5143-4aaf-9d2a-a32ad071646b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:57.518296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:57.534940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:57.543306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab72611-c1dd-4b52-bbb4-bd82716a1e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:57.544960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab72611-c1dd-4b52-bbb4-bd82716a1e10 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:57.607113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a0e3-5143-4aaf-9d2a-a32ad071646b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:57.643499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663bd6c-e6e9-4314-8eb1-fe0af55f02d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:57.644118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663bd6c-e6e9-4314-8eb1-fe0af55f02d1 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:57.644413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663bd6c-e6e9-4314-8eb1-fe0af55f02d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:57.644760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663bd6c-e6e9-4314-8eb1-fe0af55f02d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:57.659836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 336/666] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:57.659836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab72611-c1dd-4b52-bbb4-bd82716a1e10 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:57.727341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663bd6c-e6e9-4314-8eb1-fe0af55f02d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:57.728744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663bd6c-e6e9-4314-8eb1-fe0af55f02d1 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:57.750035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:57.761123 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:57.770318 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab72611-c1dd-4b52-bbb4-bd82716a1e10 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:57.807941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490cfa-4918-4bb3-99fc-bf03ca62c79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:57.808691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490cfa-4918-4bb3-99fc-bf03ca62c79e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:57.809038 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490cfa-4918-4bb3-99fc-bf03ca62c79e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:57.809409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490cfa-4918-4bb3-99fc-bf03ca62c79e None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:57.810193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490cfa-4918-4bb3-99fc-bf03ca62c79e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:57.810566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490cfa-4918-4bb3-99fc-bf03ca62c79e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:57.812083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490cfa-4918-4bb3-99fc-bf03ca62c79e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:57.825238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 337/667] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:57.826213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490cfa-4918-4bb3-99fc-bf03ca62c79e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:57.852932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 331/668] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:57.854142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663bd6c-e6e9-4314-8eb1-fe0af55f02d1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:57.937006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490cfa-4918-4bb3-99fc-bf03ca62c79e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:57.959600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663bd6c-e6e9-4314-8eb1-fe0af55f02d1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:57.972350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df5591-30b8-4ae5-b4d8-266d46edad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:57.972997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5591-30b8-4ae5-b4d8-266d46edad70 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:57.973275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5591-30b8-4ae5-b4d8-266d46edad70 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:57.973531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5591-30b8-4ae5-b4d8-266d46edad70 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:57.974196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df5591-30b8-4ae5-b4d8-266d46edad70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:57.974493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df5591-30b8-4ae5-b4d8-266d46edad70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:57.975865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df5591-30b8-4ae5-b4d8-266d46edad70 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:57.977109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:57.984171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 338/669] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:13:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:57.984923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df5591-30b8-4ae5-b4d8-266d46edad70 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:57.999453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4a08c-0951-4f29-89b9-78f92f406cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:58.000075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4a08c-0951-4f29-89b9-78f92f406cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.000369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4a08c-0951-4f29-89b9-78f92f406cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.000678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4a08c-0951-4f29-89b9-78f92f406cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.002907 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:58.011403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4a08c-0951-4f29-89b9-78f92f406cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:58.014801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4a08c-0951-4f29-89b9-78f92f406cf9 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-a9c4a08c-0951-4f29-89b9-78f92f406cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:58.032470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:58.033565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:58.034532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:58.034532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:58.034532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:58.034532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 332/670] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:58.034756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4a08c-0951-4f29-89b9-78f92f406cf9 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:58.104342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df5591-30b8-4ae5-b4d8-266d46edad70 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:58.144299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4a08c-0951-4f29-89b9-78f92f406cf9 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:58.145235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dfe0f-d5c8-438d-9242-a6fb96c3f27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:58.146175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dfe0f-d5c8-438d-9242-a6fb96c3f27b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.146456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dfe0f-d5c8-438d-9242-a6fb96c3f27b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.146774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dfe0f-d5c8-438d-9242-a6fb96c3f27b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.148251 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dfe0f-d5c8-438d-9242-a6fb96c3f27b None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=f9988b9fef5c4d559b1918ffe040aaa8) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:58.148599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dfe0f-d5c8-438d-9242-a6fb96c3f27b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:58.150115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dfe0f-d5c8-438d-9242-a6fb96c3f27b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:58.157442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 339/671] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:57 2022] GET /identity/v3/role_assignments?user.id=f9988b9fef5c4d559b1918ffe040aaa8&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:58.159120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c28036-7ea1-4e90-99dd-80805f7ce7b3 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.159401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c28036-7ea1-4e90-99dd-80805f7ce7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.159673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c28036-7ea1-4e90-99dd-80805f7ce7b3 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.165508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 340/672] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:13:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:58.166494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c28036-7ea1-4e90-99dd-80805f7ce7b3 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:58.188634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a8c7f-eab9-49b1-8feb-4b1727425a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:58.189444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8c7f-eab9-49b1-8feb-4b1727425a22 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.190015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8c7f-eab9-49b1-8feb-4b1727425a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.190347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8c7f-eab9-49b1-8feb-4b1727425a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.206176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a8c7f-eab9-49b1-8feb-4b1727425a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:58.208159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a8c7f-eab9-49b1-8feb-4b1727425a22 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-5e4a8c7f-eab9-49b1-8feb-4b1727425a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:58.225793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:58.227023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:58.228190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:58.228190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:58.228190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:58.232538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 333/673] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:58.233797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a8c7f-eab9-49b1-8feb-4b1727425a22 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:58.264104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:58.266332 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:58.288417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c28036-7ea1-4e90-99dd-80805f7ce7b3 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:58.330378 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c620d-a7b8-4d2d-a510-7d800745f9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:58.331196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c620d-a7b8-4d2d-a510-7d800745f9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.331570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c620d-a7b8-4d2d-a510-7d800745f9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.331933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c620d-a7b8-4d2d-a510-7d800745f9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.344372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c620d-a7b8-4d2d-a510-7d800745f9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:58.345991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c620d-a7b8-4d2d-a510-7d800745f9a4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-e06c620d-a7b8-4d2d-a510-7d800745f9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:58.363478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:58.364711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:58.365820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:58.365820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:58.365820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:58.366430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a8c7f-eab9-49b1-8feb-4b1727425a22 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:58.367235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 341/674] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:58.369373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396ef8-70d1-4eed-bedf-3b76e84f50c3 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.369782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396ef8-70d1-4eed-bedf-3b76e84f50c3 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.370144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396ef8-70d1-4eed-bedf-3b76e84f50c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.391217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-e7396ef8-70d1-4eed-bedf-3b76e84f50c3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:58.391818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e7396ef8-70d1-4eed-bedf-3b76e84f50c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:58.419076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3669ca-af04-45af-be28-efbc4dda225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:58.419714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3669ca-af04-45af-be28-efbc4dda225f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.419991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3669ca-af04-45af-be28-efbc4dda225f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.420270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3669ca-af04-45af-be28-efbc4dda225f None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.422552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3669ca-af04-45af-be28-efbc4dda225f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:58.422866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3669ca-af04-45af-be28-efbc4dda225f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:58.426199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3669ca-af04-45af-be28-efbc4dda225f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:58.440940 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 334/675] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:58.441451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3669ca-af04-45af-be28-efbc4dda225f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:58.479157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 342/676] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:13:58.484555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7396ef8-70d1-4eed-bedf-3b76e84f50c3 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:58.537870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:58.557269 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3669ca-af04-45af-be28-efbc4dda225f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:58.566774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:58.597527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a9ac-1b9d-42cc-b59e-cf596b5eb45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:58.598388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a9ac-1b9d-42cc-b59e-cf596b5eb45f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.598801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a9ac-1b9d-42cc-b59e-cf596b5eb45f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.599204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a9ac-1b9d-42cc-b59e-cf596b5eb45f None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.600010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4a9ac-1b9d-42cc-b59e-cf596b5eb45f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:58.600474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4a9ac-1b9d-42cc-b59e-cf596b5eb45f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:58.602042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4a9ac-1b9d-42cc-b59e-cf596b5eb45f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:58.614296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 335/677] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:58.615391 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a9ac-1b9d-42cc-b59e-cf596b5eb45f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:58.615675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7396ef8-70d1-4eed-bedf-3b76e84f50c3 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:58.656652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cdc8b-9c2c-47e9-88d1-c3976737f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:58.657562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cdc8b-9c2c-47e9-88d1-c3976737f047 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.657980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cdc8b-9c2c-47e9-88d1-c3976737f047 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.658484 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cdc8b-9c2c-47e9-88d1-c3976737f047 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.659395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cdc8b-9c2c-47e9-88d1-c3976737f047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:58.659837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cdc8b-9c2c-47e9-88d1-c3976737f047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:58.661937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cdc8b-9c2c-47e9-88d1-c3976737f047 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:58.682775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 343/678] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:58.682775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cdc8b-9c2c-47e9-88d1-c3976737f047 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:58.742714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a9ac-1b9d-42cc-b59e-cf596b5eb45f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:58.779595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a995ee-3c78-4bcf-a5c3-9bb216a50fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:58.780357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a995ee-3c78-4bcf-a5c3-9bb216a50fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.780750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a995ee-3c78-4bcf-a5c3-9bb216a50fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.781125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a995ee-3c78-4bcf-a5c3-9bb216a50fb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.788794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a995ee-3c78-4bcf-a5c3-9bb216a50fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:58.790562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a995ee-3c78-4bcf-a5c3-9bb216a50fb1 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:58.798478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cdc8b-9c2c-47e9-88d1-c3976737f047 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-43a995ee-3c78-4bcf-a5c3-9bb216a50fb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:58.804253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:58.805395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:58.806531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:58.806531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:58.806531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:58.806531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:58.806531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:58.806531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:58.806531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:58.806531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:58.810894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 336/679] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:58.810894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a995ee-3c78-4bcf-a5c3-9bb216a50fb1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:58.811701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:58.824764 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:58.837392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e9c57-e8ca-4b53-9fcc-241cb6c052cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:58.838030 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9c57-e8ca-4b53-9fcc-241cb6c052cf None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.838302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9c57-e8ca-4b53-9fcc-241cb6c052cf None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.838568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9c57-e8ca-4b53-9fcc-241cb6c052cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.845242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e9c57-e8ca-4b53-9fcc-241cb6c052cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:58.846774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e9c57-e8ca-4b53-9fcc-241cb6c052cf None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-a94e9c57-e8ca-4b53-9fcc-241cb6c052cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:13:58.857797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:58.858690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:58.859585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:13:58.859585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:13:58.859585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:13:58.859585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:13:58.859585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:13:58.859585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:13:58.859585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:13:58.859585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:58.859585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 344/680] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:13:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:58.860067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e9c57-e8ca-4b53-9fcc-241cb6c052cf None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:58.923146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a995ee-3c78-4bcf-a5c3-9bb216a50fb1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:58.959466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ec65e-260f-4a3f-9449-18491e85d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:58.960430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec65e-260f-4a3f-9449-18491e85d359 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:58.960802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec65e-260f-4a3f-9449-18491e85d359 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:58.961471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec65e-260f-4a3f-9449-18491e85d359 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:58.963848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e9c57-e8ca-4b53-9fcc-241cb6c052cf None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:58.969523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ec65e-260f-4a3f-9449-18491e85d359 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:58.971299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ec65e-260f-4a3f-9449-18491e85d359 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-4a2ec65e-260f-4a3f-9449-18491e85d359 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:13:58.982678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:58.983848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:58.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:58.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:58.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:13:58.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:13:58.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:13:58.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:13:58.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:13:58.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:13:58.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:13:58.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:13:58.990698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 337/681] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:13:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:58.991361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ec65e-260f-4a3f-9449-18491e85d359 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:59.002348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d70874-13ba-4820-80cf-459f9b9cb749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:59.003113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70874-13ba-4820-80cf-459f9b9cb749 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:59.003497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70874-13ba-4820-80cf-459f9b9cb749 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:59.003868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70874-13ba-4820-80cf-459f9b9cb749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:59.016090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d70874-13ba-4820-80cf-459f9b9cb749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:59.017763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d70874-13ba-4820-80cf-459f9b9cb749 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-d1d70874-13ba-4820-80cf-459f9b9cb749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:13:59.033225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:13:59.034409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:13:59.035313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:13:59.035313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:13:59.035313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:13:59.035313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 345/682] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:13:59.035545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d70874-13ba-4820-80cf-459f9b9cb749 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:59.064553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:59.073299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:59.110047 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ec65e-260f-4a3f-9449-18491e85d359 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:59.144372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d70874-13ba-4820-80cf-459f9b9cb749 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:59.148002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fd62d-7a2f-4130-9c47-bb74d2b7e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:59.148764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fd62d-7a2f-4130-9c47-bb74d2b7e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:59.149134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fd62d-7a2f-4130-9c47-bb74d2b7e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:59.149497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fd62d-7a2f-4130-9c47-bb74d2b7e4d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:59.150327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fd62d-7a2f-4130-9c47-bb74d2b7e4d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:59.150732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fd62d-7a2f-4130-9c47-bb74d2b7e4d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:59.152238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fd62d-7a2f-4130-9c47-bb74d2b7e4d6 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:59.169323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 338/683] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:59.169323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fd62d-7a2f-4130-9c47-bb74d2b7e4d6 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:59.185783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b79f-8c6e-4a22-928c-7eb6c045aa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:59.186511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b79f-8c6e-4a22-928c-7eb6c045aa29 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:59.186847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b79f-8c6e-4a22-928c-7eb6c045aa29 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:59.187188 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b79f-8c6e-4a22-928c-7eb6c045aa29 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:59.187941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915b79f-8c6e-4a22-928c-7eb6c045aa29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:59.188308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915b79f-8c6e-4a22-928c-7eb6c045aa29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:59.189930 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915b79f-8c6e-4a22-928c-7eb6c045aa29 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:59.207417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 346/684] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:59.207417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b79f-8c6e-4a22-928c-7eb6c045aa29 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:59.274185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fd62d-7a2f-4130-9c47-bb74d2b7e4d6 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:59.298610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:59.298776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:59.306525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b79f-8c6e-4a22-928c-7eb6c045aa29 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:59.314351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ec870-20c1-48c1-aaba-f2ecb11fdc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:59.315156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ec870-20c1-48c1-aaba-f2ecb11fdc31 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:59.315448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ec870-20c1-48c1-aaba-f2ecb11fdc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:59.315784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ec870-20c1-48c1-aaba-f2ecb11fdc31 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:59.316700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ec870-20c1-48c1-aaba-f2ecb11fdc31 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:59.317071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ec870-20c1-48c1-aaba-f2ecb11fdc31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:59.318681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ec870-20c1-48c1-aaba-f2ecb11fdc31 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:59.342194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 339/685] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Sep 16 19:13:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:59.342194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ec870-20c1-48c1-aaba-f2ecb11fdc31 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:59.345125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572280c-ca81-4bb3-a936-6b56bc810c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:59.345856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572280c-ca81-4bb3-a936-6b56bc810c06 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:59.346177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572280c-ca81-4bb3-a936-6b56bc810c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:59.346507 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572280c-ca81-4bb3-a936-6b56bc810c06 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:59.347245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572280c-ca81-4bb3-a936-6b56bc810c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:59.347628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572280c-ca81-4bb3-a936-6b56bc810c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:59.349099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572280c-ca81-4bb3-a936-6b56bc810c06 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:59.365103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 347/686] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:59.365103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572280c-ca81-4bb3-a936-6b56bc810c06 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:59.456125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ec870-20c1-48c1-aaba-f2ecb11fdc31 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:59.463573 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572280c-ca81-4bb3-a936-6b56bc810c06 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:59.489884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3abe11-9e00-4137-822b-4679fc9192eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:59.490864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3abe11-9e00-4137-822b-4679fc9192eb None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:59.491360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3abe11-9e00-4137-822b-4679fc9192eb None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:59.491832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3abe11-9e00-4137-822b-4679fc9192eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:59.492748 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3abe11-9e00-4137-822b-4679fc9192eb None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=f932b95e90774030b003f554d9f90481) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:59.493198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3abe11-9e00-4137-822b-4679fc9192eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:59.494882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3abe11-9e00-4137-822b-4679fc9192eb None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:59.498026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877db54-22c9-490b-80dd-836682b43d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:59.498642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877db54-22c9-490b-80dd-836682b43d36 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:59.498924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877db54-22c9-490b-80dd-836682b43d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:59.499200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877db54-22c9-490b-80dd-836682b43d36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:59.499923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877db54-22c9-490b-80dd-836682b43d36 None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=32ca32d96f9a436782ef0680f6b5dcac) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:13:59.500233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877db54-22c9-490b-80dd-836682b43d36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:59.501705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877db54-22c9-490b-80dd-836682b43d36 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:59.502314 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 340/687] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:59 2022] GET /identity/v3/role_assignments?user.id=f932b95e90774030b003f554d9f90481&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:59.503269 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3abe11-9e00-4137-822b-4679fc9192eb None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:59.518519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 348/688] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:13:59 2022] GET /identity/v3/role_assignments?user.id=32ca32d96f9a436782ef0680f6b5dcac&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:13:59.519380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877db54-22c9-490b-80dd-836682b43d36 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:59.540947 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:59.568645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:59.635854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877db54-22c9-490b-80dd-836682b43d36 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:59.649379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3abe11-9e00-4137-822b-4679fc9192eb None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:59.685403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42620926-b264-4dba-91cb-7a649b1cb07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:59.686502 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42620926-b264-4dba-91cb-7a649b1cb07b None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:59.686990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42620926-b264-4dba-91cb-7a649b1cb07b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:59.687435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42620926-b264-4dba-91cb-7a649b1cb07b None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:59.688324 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2ef3f-4b83-4991-b888-1bedc8cdc47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:59.688564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42620926-b264-4dba-91cb-7a649b1cb07b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:59.689123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2ef3f-4b83-4991-b888-1bedc8cdc47c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:59.689518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2ef3f-4b83-4991-b888-1bedc8cdc47c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:59.689886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2ef3f-4b83-4991-b888-1bedc8cdc47c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:59.691549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42620926-b264-4dba-91cb-7a649b1cb07b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:59.728859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 349/689] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:13:59 2022] POST /identity/v3/users => generated 254 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:13:59.808833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2ef3f-4b83-4991-b888-1bedc8cdc47c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:59.810412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2ef3f-4b83-4991-b888-1bedc8cdc47c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:59.881741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:59.948578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 341/690] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:13:59.955922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42620926-b264-4dba-91cb-7a649b1cb07b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:00.049524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:00.079797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42620926-b264-4dba-91cb-7a649b1cb07b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:00.116603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a33a82-9960-4da4-8bf1-cc71c195b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:00.117251 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a33a82-9960-4da4-8bf1-cc71c195b83c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:00.117528 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a33a82-9960-4da4-8bf1-cc71c195b83c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:00.117806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a33a82-9960-4da4-8bf1-cc71c195b83c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:00.130786 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a33a82-9960-4da4-8bf1-cc71c195b83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:00.132341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a33a82-9960-4da4-8bf1-cc71c195b83c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-08a33a82-9960-4da4-8bf1-cc71c195b83c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:00.147279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:00.148278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:00.149204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:00.149204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:00.149204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:00.149204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 350/691] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:00.156260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2ef3f-4b83-4991-b888-1bedc8cdc47c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:00.260483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2ef3f-4b83-4991-b888-1bedc8cdc47c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:00.295906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4f44e-95d1-423f-8009-624163b8eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:00.296550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4f44e-95d1-423f-8009-624163b8eee4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:00.296827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4f44e-95d1-423f-8009-624163b8eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:00.297098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4f44e-95d1-423f-8009-624163b8eee4 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:00.297740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4f44e-95d1-423f-8009-624163b8eee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:00.298037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4f44e-95d1-423f-8009-624163b8eee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:00.299651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4f44e-95d1-423f-8009-624163b8eee4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:00.311585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 342/692] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:00.316960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a33a82-9960-4da4-8bf1-cc71c195b83c None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:00.456973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a33a82-9960-4da4-8bf1-cc71c195b83c None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:00.489148 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:00.498555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431d624-6b5f-4657-98f4-9d475b6ef90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:00.499629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d624-6b5f-4657-98f4-9d475b6ef90c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:00.500179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d624-6b5f-4657-98f4-9d475b6ef90c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:00.500858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d624-6b5f-4657-98f4-9d475b6ef90c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:00.508411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431d624-6b5f-4657-98f4-9d475b6ef90c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:00.509899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431d624-6b5f-4657-98f4-9d475b6ef90c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-6431d624-6b5f-4657-98f4-9d475b6ef90c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:00.523135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:00.525368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:00.527402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:00.527402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:00.527402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:00.527402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:00.527402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:00.527402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:00.527402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:00.527402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:00.527402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 351/693] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:00.536416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4f44e-95d1-423f-8009-624163b8eee4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:00.536416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:00.641538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4f44e-95d1-423f-8009-624163b8eee4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:00.668660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b3867-0b72-401c-82aa-6577a332b22b None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:00.669352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b3867-0b72-401c-82aa-6577a332b22b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:00.669352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b3867-0b72-401c-82aa-6577a332b22b None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:00.671613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 352/694] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:00.682920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbd70a-ceb1-479f-883b-68e14118b073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:00.683545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbd70a-ceb1-479f-883b-68e14118b073 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:00.683825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbd70a-ceb1-479f-883b-68e14118b073 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:00.684102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbd70a-ceb1-479f-883b-68e14118b073 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:00.684832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbd70a-ceb1-479f-883b-68e14118b073 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:00.685140 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbd70a-ceb1-479f-883b-68e14118b073 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:00.686573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbd70a-ceb1-479f-883b-68e14118b073 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:00.690145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba73d44-e920-4000-95be-ed1b495a6232 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:00.690429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba73d44-e920-4000-95be-ed1b495a6232 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:00.690705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba73d44-e920-4000-95be-ed1b495a6232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:00.700416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 343/695] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:00.707204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbd70a-ceb1-479f-883b-68e14118b073 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:00.731360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4ba73d44-e920-4000-95be-ed1b495a6232 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:00.732609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4ba73d44-e920-4000-95be-ed1b495a6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:00.834368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:00.863860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 353/696] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:14:00.913761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbd70a-ceb1-479f-883b-68e14118b073 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:00.966414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ef138-5b1c-4637-b3cd-9fed6b4b1d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:00.966946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ef138-5b1c-4637-b3cd-9fed6b4b1d98 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:00.967218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ef138-5b1c-4637-b3cd-9fed6b4b1d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:00.967480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ef138-5b1c-4637-b3cd-9fed6b4b1d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:00.968201 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ef138-5b1c-4637-b3cd-9fed6b4b1d98 None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=94828db5fc064a539b5b7b17cac1602b) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:00.968532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ef138-5b1c-4637-b3cd-9fed6b4b1d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:00.969954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ef138-5b1c-4637-b3cd-9fed6b4b1d98 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:00.979752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 344/697] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:00 2022] GET /identity/v3/role_assignments?user.id=94828db5fc064a539b5b7b17cac1602b&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:01.203610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba73d44-e920-4000-95be-ed1b495a6232 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:01.316127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba73d44-e920-4000-95be-ed1b495a6232 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:01.334077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:01.352337 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702504b8-00c7-4bba-8f3d-ef52639286ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:01.353003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702504b8-00c7-4bba-8f3d-ef52639286ca None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:01.353275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702504b8-00c7-4bba-8f3d-ef52639286ca None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:01.353542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702504b8-00c7-4bba-8f3d-ef52639286ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:01.364567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702504b8-00c7-4bba-8f3d-ef52639286ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-702504b8-00c7-4bba-8f3d-ef52639286ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:01.369391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:01.370298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:01.371140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 354/698] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:01.376858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ef138-5b1c-4637-b3cd-9fed6b4b1d98 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:01.495491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ef138-5b1c-4637-b3cd-9fed6b4b1d98 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:01.524398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:01.534050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb722-60d3-4dbf-b0e8-de2701376e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:01.534659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb722-60d3-4dbf-b0e8-de2701376e5d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:01.534942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb722-60d3-4dbf-b0e8-de2701376e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:01.535215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb722-60d3-4dbf-b0e8-de2701376e5d None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:01.535892 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cb722-60d3-4dbf-b0e8-de2701376e5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:01.536257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cb722-60d3-4dbf-b0e8-de2701376e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:01.537783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cb722-60d3-4dbf-b0e8-de2701376e5d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:01.548531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 345/699] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:14:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:01.552860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702504b8-00c7-4bba-8f3d-ef52639286ca None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:01.684714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702504b8-00c7-4bba-8f3d-ef52639286ca None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:01.723239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256b1e-d701-4090-a6c0-0e459de71a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:01.723892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256b1e-d701-4090-a6c0-0e459de71a3e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:01.724169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256b1e-d701-4090-a6c0-0e459de71a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:01.724476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256b1e-d701-4090-a6c0-0e459de71a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:01.734928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48256b1e-d701-4090-a6c0-0e459de71a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:01.736653 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48256b1e-d701-4090-a6c0-0e459de71a3e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-48256b1e-d701-4090-a6c0-0e459de71a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:01.753394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:01.754557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:01.755520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:01.755520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:01.755520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:01.755520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 355/700] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:01.766329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb722-60d3-4dbf-b0e8-de2701376e5d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:01.904881 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb722-60d3-4dbf-b0e8-de2701376e5d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:01.954136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07396408-f8e3-4a63-bf9c-6950b667a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:01.955111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07396408-f8e3-4a63-bf9c-6950b667a96c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:01.955697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07396408-f8e3-4a63-bf9c-6950b667a96c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:01.956305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07396408-f8e3-4a63-bf9c-6950b667a96c None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:01.957123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07396408-f8e3-4a63-bf9c-6950b667a96c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:01.957575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07396408-f8e3-4a63-bf9c-6950b667a96c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:01.959094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07396408-f8e3-4a63-bf9c-6950b667a96c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:01.976331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 346/701] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:01.982058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256b1e-d701-4090-a6c0-0e459de71a3e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:02.028701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:02.123044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256b1e-d701-4090-a6c0-0e459de71a3e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:02.167981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e9d2-33ec-4d95-bbc7-99e38512b752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:02.168644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e9d2-33ec-4d95-bbc7-99e38512b752 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:02.168917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e9d2-33ec-4d95-bbc7-99e38512b752 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:02.169182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e9d2-33ec-4d95-bbc7-99e38512b752 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:02.181458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02e9d2-33ec-4d95-bbc7-99e38512b752 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:02.182983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02e9d2-33ec-4d95-bbc7-99e38512b752 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-2b02e9d2-33ec-4d95-bbc7-99e38512b752 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:02.195087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:02.196116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:02.197665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 356/702] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Sep 16 19:14:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:02.202028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07396408-f8e3-4a63-bf9c-6950b667a96c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:02.281127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:02.351818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07396408-f8e3-4a63-bf9c-6950b667a96c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:02.390619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0b028-42c4-420e-ad4a-3f2c212b490a None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:02.391011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0b028-42c4-420e-ad4a-3f2c212b490a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:02.391209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0b028-42c4-420e-ad4a-3f2c212b490a None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:02.393143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 357/703] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:02.399460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc68465-c98f-4e25-8210-3ec6307deadc None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:02.399817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc68465-c98f-4e25-8210-3ec6307deadc None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:02.400009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc68465-c98f-4e25-8210-3ec6307deadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:02.401473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e9814-9f5f-43d8-8309-e5bdae1bb4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:02.402111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e9814-9f5f-43d8-8309-e5bdae1bb4dc None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:02.402392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e9814-9f5f-43d8-8309-e5bdae1bb4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:02.402666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e9814-9f5f-43d8-8309-e5bdae1bb4dc None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:02.403574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e9814-9f5f-43d8-8309-e5bdae1bb4dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:02.403887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e9814-9f5f-43d8-8309-e5bdae1bb4dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:02.405408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e9814-9f5f-43d8-8309-e5bdae1bb4dc None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:02.427264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 347/704] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Sep 16 19:14:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:02.428576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018cc87-5b68-498f-8ad5-a2d3afd0aa80 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:02.428855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018cc87-5b68-498f-8ad5-a2d3afd0aa80 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:02.429123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018cc87-5b68-498f-8ad5-a2d3afd0aa80 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:02.430531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 348/705] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:02.430777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-fbc68465-c98f-4e25-8210-3ec6307deadc None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:02.432100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-fbc68465-c98f-4e25-8210-3ec6307deadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:02.436419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018cc87-5b68-498f-8ad5-a2d3afd0aa80 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:02.506435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 358/706] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:14:02.507841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89758e38-a30d-40d8-93cd-2d7962c42459 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:02.508133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89758e38-a30d-40d8-93cd-2d7962c42459 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:02.508432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89758e38-a30d-40d8-93cd-2d7962c42459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:02.527736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-89758e38-a30d-40d8-93cd-2d7962c42459 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:02.529093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-89758e38-a30d-40d8-93cd-2d7962c42459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:02.544416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:02.556005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018cc87-5b68-498f-8ad5-a2d3afd0aa80 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:02.567537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:02.596575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30056ec-57ab-48d0-a721-d623caa1c4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:02.597544 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30056ec-57ab-48d0-a721-d623caa1c4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:02.597885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30056ec-57ab-48d0-a721-d623caa1c4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:02.598219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30056ec-57ab-48d0-a721-d623caa1c4c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:02.607735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 359/707] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:14:02.609254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f23a1-4fa8-4306-b64a-97a56d93ed76 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:02.609546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f23a1-4fa8-4306-b64a-97a56d93ed76 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:02.609872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f23a1-4fa8-4306-b64a-97a56d93ed76 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:02.611580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 360/708] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:02.617592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea848cb-5e65-4d14-a83e-c7d1cdadb64c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:02.617873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea848cb-5e65-4d14-a83e-c7d1cdadb64c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:02.618144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea848cb-5e65-4d14-a83e-c7d1cdadb64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:02.650813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6ea848cb-5e65-4d14-a83e-c7d1cdadb64c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:02.653374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6ea848cb-5e65-4d14-a83e-c7d1cdadb64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:02.730567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30056ec-57ab-48d0-a721-d623caa1c4c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:02.732065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30056ec-57ab-48d0-a721-d623caa1c4c4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:02.778418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 361/709] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:14:02.779290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea848cb-5e65-4d14-a83e-c7d1cdadb64c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:02.864931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:02.912065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea848cb-5e65-4d14-a83e-c7d1cdadb64c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:02.937814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 349/710] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:14:02.945251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30056ec-57ab-48d0-a721-d623caa1c4c4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:02.960004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:02.971401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f531d-57ce-41a6-b904-2f2cc41edb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:02.972045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f531d-57ce-41a6-b904-2f2cc41edb4d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:02.972323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f531d-57ce-41a6-b904-2f2cc41edb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:02.972629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f531d-57ce-41a6-b904-2f2cc41edb4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:02.983027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f531d-57ce-41a6-b904-2f2cc41edb4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-431f531d-57ce-41a6-b904-2f2cc41edb4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:02.987871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:02.988868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:02.989739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 362/711] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:14:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:02.991557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f531d-57ce-41a6-b904-2f2cc41edb4d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.064539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30056ec-57ab-48d0-a721-d623caa1c4c4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.095674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f531d-57ce-41a6-b904-2f2cc41edb4d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.101709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0d329-3d03-4c4a-9023-409e2b0e5677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:03.102345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0d329-3d03-4c4a-9023-409e2b0e5677 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:03.102655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0d329-3d03-4c4a-9023-409e2b0e5677 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:03.103325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0d329-3d03-4c4a-9023-409e2b0e5677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:03.114670 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0d329-3d03-4c4a-9023-409e2b0e5677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:03.116167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0d329-3d03-4c4a-9023-409e2b0e5677 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-cee0d329-3d03-4c4a-9023-409e2b0e5677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:03.131882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:03.133150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:03.134501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:03.134501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:03.134501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:03.134501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 350/712] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:03.134501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0d329-3d03-4c4a-9023-409e2b0e5677 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.138954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d72ef-1195-43d9-9e20-b6c1ae854508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:03.139603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d72ef-1195-43d9-9e20-b6c1ae854508 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:03.139860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d72ef-1195-43d9-9e20-b6c1ae854508 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:03.140111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d72ef-1195-43d9-9e20-b6c1ae854508 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:03.140746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d72ef-1195-43d9-9e20-b6c1ae854508 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:03.142131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d72ef-1195-43d9-9e20-b6c1ae854508 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-d68d72ef-1195-43d9-9e20-b6c1ae854508 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:03.153239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:03.154326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:14:03.155214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:03.159545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 363/713] 10.222.0.49 () {56 vars in 1129 bytes} [Fri Sep 16 19:14:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:03.160274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d72ef-1195-43d9-9e20-b6c1ae854508 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.163877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:03.203617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:03.253267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0d329-3d03-4c4a-9023-409e2b0e5677 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.288497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d72ef-1195-43d9-9e20-b6c1ae854508 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.288711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adb5d7-ca4b-4d46-8c52-ae4111aa8a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:03.289145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adb5d7-ca4b-4d46-8c52-ae4111aa8a63 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:03.289419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adb5d7-ca4b-4d46-8c52-ae4111aa8a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:03.289696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adb5d7-ca4b-4d46-8c52-ae4111aa8a63 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:03.290364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adb5d7-ca4b-4d46-8c52-ae4111aa8a63 None admin] RBAC: Adding query filter params (name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:03.290666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adb5d7-ca4b-4d46-8c52-ae4111aa8a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:03.292029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adb5d7-ca4b-4d46-8c52-ae4111aa8a63 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:03.305323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 351/714] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:14:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:03.305323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adb5d7-ca4b-4d46-8c52-ae4111aa8a63 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.334394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de421301-4fda-4c06-91ed-169d83d6a9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:03.335094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de421301-4fda-4c06-91ed-169d83d6a9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:03.335306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de421301-4fda-4c06-91ed-169d83d6a9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:03.335575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de421301-4fda-4c06-91ed-169d83d6a9e4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:03.336204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de421301-4fda-4c06-91ed-169d83d6a9e4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:03.337576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de421301-4fda-4c06-91ed-169d83d6a9e4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-de421301-4fda-4c06-91ed-169d83d6a9e4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:03.346669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:03.347859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:03.348727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 364/715] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:03 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:03.349523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de421301-4fda-4c06-91ed-169d83d6a9e4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.415674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adb5d7-ca4b-4d46-8c52-ae4111aa8a63 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.417659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:03.439111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:03.453330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5cab-5e7b-468e-9d13-e91662582a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:03.453937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5cab-5e7b-468e-9d13-e91662582a1e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:03.454236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5cab-5e7b-468e-9d13-e91662582a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:03.454515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5cab-5e7b-468e-9d13-e91662582a1e None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:03.455300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5cab-5e7b-468e-9d13-e91662582a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:03.455601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5cab-5e7b-468e-9d13-e91662582a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:03.456724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de421301-4fda-4c06-91ed-169d83d6a9e4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.457066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5cab-5e7b-468e-9d13-e91662582a1e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:03.469801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 352/716] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:03.470692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5cab-5e7b-468e-9d13-e91662582a1e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.497839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1349f7-ffdd-45cd-9bdf-572bd9345333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:03.498457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1349f7-ffdd-45cd-9bdf-572bd9345333 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:03.498739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1349f7-ffdd-45cd-9bdf-572bd9345333 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:03.499017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1349f7-ffdd-45cd-9bdf-572bd9345333 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:03.499662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1349f7-ffdd-45cd-9bdf-572bd9345333 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:03.499971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1349f7-ffdd-45cd-9bdf-572bd9345333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:03.501377 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1349f7-ffdd-45cd-9bdf-572bd9345333 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:03.506196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 365/717] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Sep 16 19:14:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:03.506977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1349f7-ffdd-45cd-9bdf-572bd9345333 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.582166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5cab-5e7b-468e-9d13-e91662582a1e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.611156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1349f7-ffdd-45cd-9bdf-572bd9345333 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.619446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b123448-8cd6-4415-bb88-579dc26daea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:03.620260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b123448-8cd6-4415-bb88-579dc26daea3 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:03.620710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b123448-8cd6-4415-bb88-579dc26daea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:03.620982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b123448-8cd6-4415-bb88-579dc26daea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:03.631362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b123448-8cd6-4415-bb88-579dc26daea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:03.632840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b123448-8cd6-4415-bb88-579dc26daea3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:03.640317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:03.647368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84edbe7-d47d-4363-bd58-377a10a13c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:03.647984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84edbe7-d47d-4363-bd58-377a10a13c0b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-5b123448-8cd6-4415-bb88-579dc26daea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:03.648091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:03.649156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:03.655001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:03.655001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:03.655001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:03.655175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84edbe7-d47d-4363-bd58-377a10a13c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:03.655175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84edbe7-d47d-4363-bd58-377a10a13c0b None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:03.655175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84edbe7-d47d-4363-bd58-377a10a13c0b None admin] RBAC: Adding query filter params (name=network) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:03.655175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84edbe7-d47d-4363-bd58-377a10a13c0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:03.655427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 353/718] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:03.655427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b123448-8cd6-4415-bb88-579dc26daea3 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.655563 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84edbe7-d47d-4363-bd58-377a10a13c0b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:03.664626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 366/719] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:03.664626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84edbe7-d47d-4363-bd58-377a10a13c0b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.696526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:03.772183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b123448-8cd6-4415-bb88-579dc26daea3 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.773387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84edbe7-d47d-4363-bd58-377a10a13c0b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.807404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc088f67-3d9f-4cf9-bcdf-d64fd00bcaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:03.808133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc088f67-3d9f-4cf9-bcdf-d64fd00bcaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:03.808505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc088f67-3d9f-4cf9-bcdf-d64fd00bcaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:03.808844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc088f67-3d9f-4cf9-bcdf-d64fd00bcaf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:03.809101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecf62e-d89e-4c8c-bcfe-6ef03fcfb2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:03.809794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecf62e-d89e-4c8c-bcfe-6ef03fcfb2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:03.810082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecf62e-d89e-4c8c-bcfe-6ef03fcfb2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:03.810358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecf62e-d89e-4c8c-bcfe-6ef03fcfb2b0 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:03.810994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecf62e-d89e-4c8c-bcfe-6ef03fcfb2b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:03.811300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecf62e-d89e-4c8c-bcfe-6ef03fcfb2b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:03.812709 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecf62e-d89e-4c8c-bcfe-6ef03fcfb2b0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:03.816972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc088f67-3d9f-4cf9-bcdf-d64fd00bcaf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:03.818597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc088f67-3d9f-4cf9-bcdf-d64fd00bcaf4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:03.819044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 367/720] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Sep 16 19:14:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:03.819840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecf62e-d89e-4c8c-bcfe-6ef03fcfb2b0 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-fc088f67-3d9f-4cf9-bcdf-d64fd00bcaf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:03.845396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:03.846557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:03.847665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:03.847665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:03.847665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:03.847665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:03.847665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:03.847665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:03.847665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:03.847665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:03.849214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 354/721] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:03.850118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc088f67-3d9f-4cf9-bcdf-d64fd00bcaf4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:03.901713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:03.954662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecf62e-d89e-4c8c-bcfe-6ef03fcfb2b0 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:03.978347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:03.991949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc088f67-3d9f-4cf9-bcdf-d64fd00bcaf4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:04.002072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd64e43-ba9b-4f23-b173-1439d0f8c10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:04.003102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64e43-ba9b-4f23-b173-1439d0f8c10d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:04.003542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64e43-ba9b-4f23-b173-1439d0f8c10d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:04.003980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64e43-ba9b-4f23-b173-1439d0f8c10d None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:04.004981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd64e43-ba9b-4f23-b173-1439d0f8c10d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:04.005506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd64e43-ba9b-4f23-b173-1439d0f8c10d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:04.007174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd64e43-ba9b-4f23-b173-1439d0f8c10d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:04.027216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 368/722] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:04.028556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd64e43-ba9b-4f23-b173-1439d0f8c10d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:04.035701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badfb2a-98e3-4d93-9c75-ee9a396510fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:04.036548 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badfb2a-98e3-4d93-9c75-ee9a396510fc None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:04.036924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badfb2a-98e3-4d93-9c75-ee9a396510fc None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:04.037296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badfb2a-98e3-4d93-9c75-ee9a396510fc None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:04.038041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badfb2a-98e3-4d93-9c75-ee9a396510fc None admin] RBAC: Adding query filter params (type=network) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:04.038461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badfb2a-98e3-4d93-9c75-ee9a396510fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:04.039937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badfb2a-98e3-4d93-9c75-ee9a396510fc None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:04.052573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 355/723] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:04.052573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badfb2a-98e3-4d93-9c75-ee9a396510fc None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:04.155321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd64e43-ba9b-4f23-b173-1439d0f8c10d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:04.175296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:04.202923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badfb2a-98e3-4d93-9c75-ee9a396510fc None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:04.206144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179d21e-752c-44e2-96e0-257ae94e0b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:04.206534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d21e-752c-44e2-96e0-257ae94e0b0f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:04.206867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d21e-752c-44e2-96e0-257ae94e0b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:04.207134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d21e-752c-44e2-96e0-257ae94e0b0f None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:04.207843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179d21e-752c-44e2-96e0-257ae94e0b0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:04.208173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179d21e-752c-44e2-96e0-257ae94e0b0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:04.209704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179d21e-752c-44e2-96e0-257ae94e0b0f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:04.223240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 369/724] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:04.224706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dc70d-b7b2-4625-a17c-f119c1e5b92a None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:04.224915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dc70d-b7b2-4625-a17c-f119c1e5b92a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:04.225187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dc70d-b7b2-4625-a17c-f119c1e5b92a None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:04.230779 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 370/725] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:04.231692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dc70d-b7b2-4625-a17c-f119c1e5b92a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:04.252276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68622a3-2260-4e8e-a48b-3b8344730ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:04.254235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68622a3-2260-4e8e-a48b-3b8344730ccf None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:04.255125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68622a3-2260-4e8e-a48b-3b8344730ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:04.255595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68622a3-2260-4e8e-a48b-3b8344730ccf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:04.265977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68622a3-2260-4e8e-a48b-3b8344730ccf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:04.267655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68622a3-2260-4e8e-a48b-3b8344730ccf None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-e68622a3-2260-4e8e-a48b-3b8344730ccf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:04.282510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:04.283740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:04.285049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 356/726] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Sep 16 19:14:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:04.285712 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3742f-17f4-46f0-afb7-dafb7b6fef42 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:04.285813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3742f-17f4-46f0-afb7-dafb7b6fef42 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:04.286055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3742f-17f4-46f0-afb7-dafb7b6fef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:04.308839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-43c3742f-17f4-46f0-afb7-dafb7b6fef42 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:04.310005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-43c3742f-17f4-46f0-afb7-dafb7b6fef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:04.325059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:04.371619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dc70d-b7b2-4625-a17c-f119c1e5b92a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:04.396488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 357/727] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:14:04.397525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3742f-17f4-46f0-afb7-dafb7b6fef42 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:04.414978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de093345-c234-47ae-b704-65fb954e4f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:04.415896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de093345-c234-47ae-b704-65fb954e4f47 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:04.416318 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de093345-c234-47ae-b704-65fb954e4f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:04.416780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de093345-c234-47ae-b704-65fb954e4f47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:04.417661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de093345-c234-47ae-b704-65fb954e4f47 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=f9988b9fef5c4d559b1918ffe040aaa8) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:04.418142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de093345-c234-47ae-b704-65fb954e4f47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:04.419732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de093345-c234-47ae-b704-65fb954e4f47 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:04.433003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 371/728] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:04 2022] GET /identity/v3/role_assignments?user.id=f9988b9fef5c4d559b1918ffe040aaa8&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=71bed99a52684ba990097719b40ef99d => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:04.605710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3742f-17f4-46f0-afb7-dafb7b6fef42 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:04.653483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54190d55-ec6b-4ec4-bb5b-4a330a282e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:04.654093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190d55-ec6b-4ec4-bb5b-4a330a282e22 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:04.654368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190d55-ec6b-4ec4-bb5b-4a330a282e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:04.654640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190d55-ec6b-4ec4-bb5b-4a330a282e22 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:04.655425 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54190d55-ec6b-4ec4-bb5b-4a330a282e22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:04.655731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54190d55-ec6b-4ec4-bb5b-4a330a282e22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:04.657202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54190d55-ec6b-4ec4-bb5b-4a330a282e22 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:04.661579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de093345-c234-47ae-b704-65fb954e4f47 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:04.679069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 358/729] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Sep 16 19:14:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:04.685130 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54190d55-ec6b-4ec4-bb5b-4a330a282e22 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:04.703251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:04.732037 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:04.836017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de093345-c234-47ae-b704-65fb954e4f47 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:04.869027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54190d55-ec6b-4ec4-bb5b-4a330a282e22 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:04.899754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697b4a6-fe34-47da-a941-879d2f27edf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:04.900435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697b4a6-fe34-47da-a941-879d2f27edf9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:04.900705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697b4a6-fe34-47da-a941-879d2f27edf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:04.900976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697b4a6-fe34-47da-a941-879d2f27edf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:04.917758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697b4a6-fe34-47da-a941-879d2f27edf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:04.928159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12777d2f-86e9-4c55-87e0-6c2532e77843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-6697b4a6-fe34-47da-a941-879d2f27edf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:04.928666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:04.929634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:04.930486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:04.932242 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12777d2f-86e9-4c55-87e0-6c2532e77843 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:04.932768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12777d2f-86e9-4c55-87e0-6c2532e77843 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:04.933220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12777d2f-86e9-4c55-87e0-6c2532e77843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:04.938336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 372/730] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:04.942962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697b4a6-fe34-47da-a941-879d2f27edf9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:05.049522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12777d2f-86e9-4c55-87e0-6c2532e77843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:05.052620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12777d2f-86e9-4c55-87e0-6c2532e77843 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:05.070520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:05.134821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697b4a6-fe34-47da-a941-879d2f27edf9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:05.137395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:05.196813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f09e1-6c77-4b0b-8118-2cf3872172e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:05.197440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f09e1-6c77-4b0b-8118-2cf3872172e8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:05.197718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f09e1-6c77-4b0b-8118-2cf3872172e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:05.197989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f09e1-6c77-4b0b-8118-2cf3872172e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:05.198663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f09e1-6c77-4b0b-8118-2cf3872172e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:05.198969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f09e1-6c77-4b0b-8118-2cf3872172e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:05.200445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f09e1-6c77-4b0b-8118-2cf3872172e8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:05.214517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 373/731] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:05.222222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f09e1-6c77-4b0b-8118-2cf3872172e8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:05.252636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 359/732] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:14:05.265452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12777d2f-86e9-4c55-87e0-6c2532e77843 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:05.379089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f09e1-6c77-4b0b-8118-2cf3872172e8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:05.418403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c220aa8-9c60-4a82-a64d-e280fa712c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:05.418958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c220aa8-9c60-4a82-a64d-e280fa712c3f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:05.419235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c220aa8-9c60-4a82-a64d-e280fa712c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:05.419504 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c220aa8-9c60-4a82-a64d-e280fa712c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:05.430990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c220aa8-9c60-4a82-a64d-e280fa712c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:05.432607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c220aa8-9c60-4a82-a64d-e280fa712c3f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-2c220aa8-9c60-4a82-a64d-e280fa712c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:05.449699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:05.450698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:05.451577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:05.451577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:05.451577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:05.451577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 374/733] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:05.461812 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c220aa8-9c60-4a82-a64d-e280fa712c3f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:05.475125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12777d2f-86e9-4c55-87e0-6c2532e77843 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:05.483656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:05.512165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:05.513965 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c522c8a-d631-46c4-8523-2eb05d1443b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:05.514606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c522c8a-d631-46c4-8523-2eb05d1443b0 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:05.514894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c522c8a-d631-46c4-8523-2eb05d1443b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:05.515166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c522c8a-d631-46c4-8523-2eb05d1443b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:05.526575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c522c8a-d631-46c4-8523-2eb05d1443b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:05.528143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c522c8a-d631-46c4-8523-2eb05d1443b0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-3c522c8a-d631-46c4-8523-2eb05d1443b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:05.543784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:05.544856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:05.546285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:05.546285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:05.546285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:05.546285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 360/734] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:05.558330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c522c8a-d631-46c4-8523-2eb05d1443b0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:05.661523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c220aa8-9c60-4a82-a64d-e280fa712c3f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:05.672048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c522c8a-d631-46c4-8523-2eb05d1443b0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:05.722239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677c501-b810-4d8a-9d08-e8fb5a5f4cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:05.722857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677c501-b810-4d8a-9d08-e8fb5a5f4cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:05.723136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677c501-b810-4d8a-9d08-e8fb5a5f4cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:05.723411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677c501-b810-4d8a-9d08-e8fb5a5f4cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:05.724057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677c501-b810-4d8a-9d08-e8fb5a5f4cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:05.724359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677c501-b810-4d8a-9d08-e8fb5a5f4cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:05.725769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677c501-b810-4d8a-9d08-e8fb5a5f4cd7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:05.731624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c3375-0ed0-48db-8f43-058eaf63354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:05.732240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c3375-0ed0-48db-8f43-058eaf63354a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:05.732545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c3375-0ed0-48db-8f43-058eaf63354a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:05.732818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c3375-0ed0-48db-8f43-058eaf63354a None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:05.733465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c3375-0ed0-48db-8f43-058eaf63354a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:05.733767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c3375-0ed0-48db-8f43-058eaf63354a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:05.735112 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c3375-0ed0-48db-8f43-058eaf63354a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:05.752424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 375/735] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:05.762198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677c501-b810-4d8a-9d08-e8fb5a5f4cd7 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:05.762701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 361/736] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:05.772417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c3375-0ed0-48db-8f43-058eaf63354a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:05.816784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:05.909647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c3375-0ed0-48db-8f43-058eaf63354a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:05.934953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:05.948227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d143de-576c-43bb-8a96-75a3f624e7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:05.948964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d143de-576c-43bb-8a96-75a3f624e7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:05.949243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d143de-576c-43bb-8a96-75a3f624e7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:05.949514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d143de-576c-43bb-8a96-75a3f624e7b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:05.956826 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d143de-576c-43bb-8a96-75a3f624e7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:05.958403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d143de-576c-43bb-8a96-75a3f624e7b8 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-73d143de-576c-43bb-8a96-75a3f624e7b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:05.970788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:05.971707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:05.972612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:05.972612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:05.972612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:05.972612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:05.972612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:05.972612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:05.972612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:05.972612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:05.972612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 362/737] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:05.978849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d143de-576c-43bb-8a96-75a3f624e7b8 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:05.994409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677c501-b810-4d8a-9d08-e8fb5a5f4cd7 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:06.064921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e1627-d40a-4bcb-8b09-7c4dc14e6a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:06.065658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1627-d40a-4bcb-8b09-7c4dc14e6a43 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.065941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1627-d40a-4bcb-8b09-7c4dc14e6a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.066214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1627-d40a-4bcb-8b09-7c4dc14e6a43 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.085644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e1627-d40a-4bcb-8b09-7c4dc14e6a43 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:06.087243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e1627-d40a-4bcb-8b09-7c4dc14e6a43 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:06.088917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-4c3e1627-d40a-4bcb-8b09-7c4dc14e6a43 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:06.108249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:06.110498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:06.112766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:06.112766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:06.112766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:06.112766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:06.112766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:06.112766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:06.112766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:06.112766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:06.112766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:14:06.112766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:06.113997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d143de-576c-43bb-8a96-75a3f624e7b8 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:06.120774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 376/738] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:06.121674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e1627-d40a-4bcb-8b09-7c4dc14e6a43 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:06.148838 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969e9d6-919a-4f3a-9196-9572a08ee85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:06.149538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969e9d6-919a-4f3a-9196-9572a08ee85f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.149788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969e9d6-919a-4f3a-9196-9572a08ee85f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.150066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969e9d6-919a-4f3a-9196-9572a08ee85f None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.150875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969e9d6-919a-4f3a-9196-9572a08ee85f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:06.151182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969e9d6-919a-4f3a-9196-9572a08ee85f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:06.152653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969e9d6-919a-4f3a-9196-9572a08ee85f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:06.166355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 363/739] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:06.171729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969e9d6-919a-4f3a-9196-9572a08ee85f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:06.290261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e1627-d40a-4bcb-8b09-7c4dc14e6a43 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:06.369069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1e3d7-44b9-4498-9078-508c7fd0fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:06.369708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e3d7-44b9-4498-9078-508c7fd0fb86 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.369983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e3d7-44b9-4498-9078-508c7fd0fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.370252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e3d7-44b9-4498-9078-508c7fd0fb86 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.370998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1e3d7-44b9-4498-9078-508c7fd0fb86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:06.371303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1e3d7-44b9-4498-9078-508c7fd0fb86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:06.372804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1e3d7-44b9-4498-9078-508c7fd0fb86 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:06.381424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:06.388765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969e9d6-919a-4f3a-9196-9572a08ee85f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:06.416036 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 377/740] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Sep 16 19:14:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:06.421830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1e3d7-44b9-4498-9078-508c7fd0fb86 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:06.465770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036c13f-01c2-4aa0-8c8c-c0765bbcfe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:06.466570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036c13f-01c2-4aa0-8c8c-c0765bbcfe6c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.466798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036c13f-01c2-4aa0-8c8c-c0765bbcfe6c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.467072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036c13f-01c2-4aa0-8c8c-c0765bbcfe6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.469158 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036c13f-01c2-4aa0-8c8c-c0765bbcfe6c None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=df6eb4ca8ca1446e9bf49ce1ad73989c) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:06.469158 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036c13f-01c2-4aa0-8c8c-c0765bbcfe6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:06.470594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036c13f-01c2-4aa0-8c8c-c0765bbcfe6c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:06.485508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 364/741] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:06 2022] GET /identity/v3/role_assignments?user.id=df6eb4ca8ca1446e9bf49ce1ad73989c&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:06.488274 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3101-6b25-4620-857b-927cb3fc3ee7 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.488870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3101-6b25-4620-857b-927cb3fc3ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.489338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3101-6b25-4620-857b-927cb3fc3ee7 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.490917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 365/742] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:06.497933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a5e20-c3e0-431e-b9b7-76bdba637034 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.498765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a5e20-c3e0-431e-b9b7-76bdba637034 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.499231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a5e20-c3e0-431e-b9b7-76bdba637034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.517561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:06.539038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-433a5e20-c3e0-431e-b9b7-76bdba637034 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:06.546539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-433a5e20-c3e0-431e-b9b7-76bdba637034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:06.609477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1e3d7-44b9-4498-9078-508c7fd0fb86 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:06.679485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 366/743] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:14:06.679684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480f371-4cdd-4c9d-9924-1b802195ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:06.680070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480f371-4cdd-4c9d-9924-1b802195ab43 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.680341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480f371-4cdd-4c9d-9924-1b802195ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.680640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480f371-4cdd-4c9d-9924-1b802195ab43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.681118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf22820-ddb6-45ca-9d58-40fbc9afacfd None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.681401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf22820-ddb6-45ca-9d58-40fbc9afacfd None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.681670 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf22820-ddb6-45ca-9d58-40fbc9afacfd None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.687211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 367/744] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:06.688464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93739-bb78-41b3-aff5-8c4991da1bf5 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.688741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93739-bb78-41b3-aff5-8c4991da1bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.689050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93739-bb78-41b3-aff5-8c4991da1bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.709231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-19d93739-bb78-41b3-aff5-8c4991da1bf5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:06.710759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-19d93739-bb78-41b3-aff5-8c4991da1bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:06.763416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:06.778307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480f371-4cdd-4c9d-9924-1b802195ab43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:06.779783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480f371-4cdd-4c9d-9924-1b802195ab43 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:06.831198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 368/745] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:14:06.861972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9764d-a1f3-4eec-9b8e-28a04bd869d6 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.862308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9764d-a1f3-4eec-9b8e-28a04bd869d6 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.862535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9764d-a1f3-4eec-9b8e-28a04bd869d6 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.865283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 369/746] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:06.869253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2539f0-cc76-4a02-819a-f70a6bd5d580 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:06.869535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2539f0-cc76-4a02-819a-f70a6bd5d580 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:06.869811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2539f0-cc76-4a02-819a-f70a6bd5d580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:06.888147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4c2539f0-cc76-4a02-819a-f70a6bd5d580 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:06.889398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4c2539f0-cc76-4a02-819a-f70a6bd5d580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:06.968361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 378/747] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:14:06.969267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480f371-4cdd-4c9d-9924-1b802195ab43 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:06.983338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:07.000482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 370/748] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:14:07.001407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2539f0-cc76-4a02-819a-f70a6bd5d580 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:07.124864 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:07.136344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480f371-4cdd-4c9d-9924-1b802195ab43 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:07.156102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2539f0-cc76-4a02-819a-f70a6bd5d580 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:07.183535 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4d59d-f360-42d9-ab22-8ac62ffb6abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:07.184592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d59d-f360-42d9-ab22-8ac62ffb6abe None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:07.185037 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d59d-f360-42d9-ab22-8ac62ffb6abe None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:07.185472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d59d-f360-42d9-ab22-8ac62ffb6abe None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:07.186406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4d59d-f360-42d9-ab22-8ac62ffb6abe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:07.188054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4d59d-f360-42d9-ab22-8ac62ffb6abe None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:07.192051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96075bc-633c-4398-b030-e556c9b58002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:07.192607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96075bc-633c-4398-b030-e556c9b58002 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:07.192881 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96075bc-633c-4398-b030-e556c9b58002 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:07.193147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96075bc-633c-4398-b030-e556c9b58002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:07.206254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96075bc-633c-4398-b030-e556c9b58002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:07.207829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96075bc-633c-4398-b030-e556c9b58002 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:07.212017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 379/749] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:14:06 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:07.213177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4d59d-f360-42d9-ab22-8ac62ffb6abe None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-c96075bc-633c-4398-b030-e556c9b58002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:07.223896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:07.225515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:07.226422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:07.226422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:07.226422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:07.226422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 371/750] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:07.237494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96075bc-633c-4398-b030-e556c9b58002 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:07.308559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:07.343781 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4d59d-f360-42d9-ab22-8ac62ffb6abe None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:07.378133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96075bc-633c-4398-b030-e556c9b58002 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:07.382462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3923499-264e-4771-8ad6-ef45a6f4b172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:07.383091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3923499-264e-4771-8ad6-ef45a6f4b172 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:07.383433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3923499-264e-4771-8ad6-ef45a6f4b172 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:07.383711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3923499-264e-4771-8ad6-ef45a6f4b172 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:07.384414 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3923499-264e-4771-8ad6-ef45a6f4b172 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:07.387158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3923499-264e-4771-8ad6-ef45a6f4b172 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:07.412494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 380/751] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:14:07 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:07.413987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3923499-264e-4771-8ad6-ef45a6f4b172 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:07.442205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:07.465152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d91b22-5b9b-43dd-9e61-cc6a35defdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:07.465779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91b22-5b9b-43dd-9e61-cc6a35defdec None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:07.466053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91b22-5b9b-43dd-9e61-cc6a35defdec None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:07.466321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91b22-5b9b-43dd-9e61-cc6a35defdec None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:07.466979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d91b22-5b9b-43dd-9e61-cc6a35defdec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:07.467281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d91b22-5b9b-43dd-9e61-cc6a35defdec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:07.468694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d91b22-5b9b-43dd-9e61-cc6a35defdec None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:07.488441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 372/752] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:07.494317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d91b22-5b9b-43dd-9e61-cc6a35defdec None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:07.583885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3923499-264e-4771-8ad6-ef45a6f4b172 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:07.633258 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206f145-9759-4925-a0fa-16881700916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:07.633834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206f145-9759-4925-a0fa-16881700916b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:07.634145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206f145-9759-4925-a0fa-16881700916b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:07.634423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206f145-9759-4925-a0fa-16881700916b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:07.647431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:07.649590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206f145-9759-4925-a0fa-16881700916b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:07.651319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d91b22-5b9b-43dd-9e61-cc6a35defdec None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-0206f145-9759-4925-a0fa-16881700916b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:07.655153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:07.656209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:07.657601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 381/753] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:07.664629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206f145-9759-4925-a0fa-16881700916b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:07.691617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220275f9-15de-47d7-8fea-e30375601460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:07.692253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220275f9-15de-47d7-8fea-e30375601460 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:07.693105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220275f9-15de-47d7-8fea-e30375601460 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:07.693384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220275f9-15de-47d7-8fea-e30375601460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:07.702844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220275f9-15de-47d7-8fea-e30375601460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:07.705706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220275f9-15de-47d7-8fea-e30375601460 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-220275f9-15de-47d7-8fea-e30375601460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:07.719341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:07.720690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:07.721702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:07.721702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:07.721702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:07.721702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:07.721702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:07.721702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:07.721702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:07.721702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:07.722726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 373/754] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:07.728309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220275f9-15de-47d7-8fea-e30375601460 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:07.777371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:07.850614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206f145-9759-4925-a0fa-16881700916b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:07.855348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220275f9-15de-47d7-8fea-e30375601460 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:07.894760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c7002-323a-414d-a0ee-9a061af48555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:07.895732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7002-323a-414d-a0ee-9a061af48555 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:07.896570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7002-323a-414d-a0ee-9a061af48555 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:07.897126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7002-323a-414d-a0ee-9a061af48555 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:07.898046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c7002-323a-414d-a0ee-9a061af48555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:07.898538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c7002-323a-414d-a0ee-9a061af48555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:07.900152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c7002-323a-414d-a0ee-9a061af48555 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:07.915473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 374/755] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:07.921299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c7002-323a-414d-a0ee-9a061af48555 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:07.936613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1e1ac-79a5-47c6-a4aa-6da4e7118b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:07.937632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1e1ac-79a5-47c6-a4aa-6da4e7118b9b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:07.938123 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1e1ac-79a5-47c6-a4aa-6da4e7118b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:07.938652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1e1ac-79a5-47c6-a4aa-6da4e7118b9b None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:07.939636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1e1ac-79a5-47c6-a4aa-6da4e7118b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:07.940227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1e1ac-79a5-47c6-a4aa-6da4e7118b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:07.942536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1e1ac-79a5-47c6-a4aa-6da4e7118b9b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:07.954182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 382/756] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:07.959739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1e1ac-79a5-47c6-a4aa-6da4e7118b9b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:07.967702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:08.077704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1e1ac-79a5-47c6-a4aa-6da4e7118b9b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:08.120752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:08.127412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ea4ad-aec6-445d-a291-b5e6ac0e745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:08.128198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ea4ad-aec6-445d-a291-b5e6ac0e745e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:08.128540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ea4ad-aec6-445d-a291-b5e6ac0e745e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:08.128810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ea4ad-aec6-445d-a291-b5e6ac0e745e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:08.130871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c7002-323a-414d-a0ee-9a061af48555 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:08.149791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ea4ad-aec6-445d-a291-b5e6ac0e745e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:08.151193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ea4ad-aec6-445d-a291-b5e6ac0e745e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-677ea4ad-aec6-445d-a291-b5e6ac0e745e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:08.178877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:08.179883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:08.180807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:08.180807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:08.180807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:08.187899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 383/757] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:08.188770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ea4ad-aec6-445d-a291-b5e6ac0e745e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:08.199826 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf592b-abec-4911-a136-0abc349eebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:08.201177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf592b-abec-4911-a136-0abc349eebc5 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:08.201663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf592b-abec-4911-a136-0abc349eebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:08.202189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf592b-abec-4911-a136-0abc349eebc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:08.203201 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf592b-abec-4911-a136-0abc349eebc5 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=94828db5fc064a539b5b7b17cac1602b) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:08.203739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf592b-abec-4911-a136-0abc349eebc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:08.205580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf592b-abec-4911-a136-0abc349eebc5 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:08.220435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 375/758] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:07 2022] GET /identity/v3/role_assignments?user.id=94828db5fc064a539b5b7b17cac1602b&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=71bed99a52684ba990097719b40ef99d => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:08.322403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ea4ad-aec6-445d-a291-b5e6ac0e745e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:08.376101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45274d1b-979a-4ba5-8dbd-a77442f5b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:08.377193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274d1b-979a-4ba5-8dbd-a77442f5b5fe None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:08.377564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274d1b-979a-4ba5-8dbd-a77442f5b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:08.377838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274d1b-979a-4ba5-8dbd-a77442f5b5fe None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:08.378498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45274d1b-979a-4ba5-8dbd-a77442f5b5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:08.378799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45274d1b-979a-4ba5-8dbd-a77442f5b5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:08.380190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45274d1b-979a-4ba5-8dbd-a77442f5b5fe None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:08.396843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 384/759] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:08.402449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf592b-abec-4911-a136-0abc349eebc5 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:08.522506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:08.543035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf592b-abec-4911-a136-0abc349eebc5 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:08.594018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f56bd-a4c8-48a0-8bcd-ffb76a7ae445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:08.594670 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f56bd-a4c8-48a0-8bcd-ffb76a7ae445 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:08.594945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f56bd-a4c8-48a0-8bcd-ffb76a7ae445 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:08.595425 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f56bd-a4c8-48a0-8bcd-ffb76a7ae445 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:08.603435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f56bd-a4c8-48a0-8bcd-ffb76a7ae445 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:08.604938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f56bd-a4c8-48a0-8bcd-ffb76a7ae445 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-8f2f56bd-a4c8-48a0-8bcd-ffb76a7ae445 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:08.616357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:08.617435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:08.618937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:08.618937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:08.618937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:08.618937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:08.618937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:08.618937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:08.618937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:08.618937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:08.618937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:08.618937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:08.622204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 376/760] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Sep 16 19:14:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:08.623603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45274d1b-979a-4ba5-8dbd-a77442f5b5fe None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:08.684040 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:08.765301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45274d1b-979a-4ba5-8dbd-a77442f5b5fe None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:08.814072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90a21-7151-4198-b863-123885ab92e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:08.814784 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90a21-7151-4198-b863-123885ab92e8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:08.815068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90a21-7151-4198-b863-123885ab92e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:08.815343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90a21-7151-4198-b863-123885ab92e8 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:08.816088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f90a21-7151-4198-b863-123885ab92e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:08.816409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f90a21-7151-4198-b863-123885ab92e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:08.817870 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f90a21-7151-4198-b863-123885ab92e8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:08.844048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 385/761] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Sep 16 19:14:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:08.850050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f56bd-a4c8-48a0-8bcd-ffb76a7ae445 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:08.979440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f56bd-a4c8-48a0-8bcd-ffb76a7ae445 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:09.026992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26242a-23af-44e2-bc6b-1ab38b9e4da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:09.027641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26242a-23af-44e2-bc6b-1ab38b9e4da8 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:09.027923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26242a-23af-44e2-bc6b-1ab38b9e4da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:09.028192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26242a-23af-44e2-bc6b-1ab38b9e4da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:09.044726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26242a-23af-44e2-bc6b-1ab38b9e4da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:09.046193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26242a-23af-44e2-bc6b-1ab38b9e4da8 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:09.050996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-2b26242a-23af-44e2-bc6b-1ab38b9e4da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:09.069459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:09.070453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:09.071332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:09.071332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:09.071332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:09.071332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 377/762] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:09.076577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90a21-7151-4198-b863-123885ab92e8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:09.247301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90a21-7151-4198-b863-123885ab92e8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:09.248876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:09.297790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff86de3-2fc5-477f-9ac4-3b2ae3c166b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:09.298498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff86de3-2fc5-477f-9ac4-3b2ae3c166b8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:09.298782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff86de3-2fc5-477f-9ac4-3b2ae3c166b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:09.299052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff86de3-2fc5-477f-9ac4-3b2ae3c166b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:09.299706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff86de3-2fc5-477f-9ac4-3b2ae3c166b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:09.300011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff86de3-2fc5-477f-9ac4-3b2ae3c166b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:09.301424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff86de3-2fc5-477f-9ac4-3b2ae3c166b8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:09.321091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 386/763] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:09.326681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26242a-23af-44e2-bc6b-1ab38b9e4da8 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:09.368044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0328-2578-485e-9805-192b64836a77 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:09.368430 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0328-2578-485e-9805-192b64836a77 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:09.368634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0328-2578-485e-9805-192b64836a77 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:09.370292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 387/764] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:09.375706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f8fb-2307-4903-8d77-bafcfb12eb60 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:09.376063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f8fb-2307-4903-8d77-bafcfb12eb60 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:09.376406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f8fb-2307-4903-8d77-bafcfb12eb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:09.405074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ce63f8fb-2307-4903-8d77-bafcfb12eb60 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:09.406383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ce63f8fb-2307-4903-8d77-bafcfb12eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:09.522888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26242a-23af-44e2-bc6b-1ab38b9e4da8 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:09.549683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 388/765] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:09.575394 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49aa1c-10d5-4fd7-8e85-2678f1c3a9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:09.576028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49aa1c-10d5-4fd7-8e85-2678f1c3a9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:09.576410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49aa1c-10d5-4fd7-8e85-2678f1c3a9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:09.576693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49aa1c-10d5-4fd7-8e85-2678f1c3a9e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:09.587081 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49aa1c-10d5-4fd7-8e85-2678f1c3a9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:09.588563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49aa1c-10d5-4fd7-8e85-2678f1c3a9e3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-9b49aa1c-10d5-4fd7-8e85-2678f1c3a9e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:09.604078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:09.605037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:09.605926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:09.605926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:09.605926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:09.605926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:09.605926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:09.605926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:09.605926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:09.605926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:09.605926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 378/766] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:09.611161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f8fb-2307-4903-8d77-bafcfb12eb60 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:09.727102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:09.739572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f8fb-2307-4903-8d77-bafcfb12eb60 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:09.798224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1bfc5-06d5-4e13-b8c8-f59e69d602b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:09.798772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1bfc5-06d5-4e13-b8c8-f59e69d602b1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:09.799049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1bfc5-06d5-4e13-b8c8-f59e69d602b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:09.799317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1bfc5-06d5-4e13-b8c8-f59e69d602b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:09.800014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1bfc5-06d5-4e13-b8c8-f59e69d602b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:09.800315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1bfc5-06d5-4e13-b8c8-f59e69d602b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:09.801786 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1bfc5-06d5-4e13-b8c8-f59e69d602b1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:09.819187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 389/767] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:09.825240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49aa1c-10d5-4fd7-8e85-2678f1c3a9e3 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:09.885965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed985d0-c5ee-4167-a8cc-59600d00f3ba None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:09.886298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed985d0-c5ee-4167-a8cc-59600d00f3ba None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:09.886512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed985d0-c5ee-4167-a8cc-59600d00f3ba None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:09.888319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 390/768] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:09.895996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:09.901540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ec4b9-3430-48f7-a0c8-75bb1fab291f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:09.901815 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ec4b9-3430-48f7-a0c8-75bb1fab291f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:09.902082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ec4b9-3430-48f7-a0c8-75bb1fab291f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:09.937409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-e55ec4b9-3430-48f7-a0c8-75bb1fab291f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:09.938603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e55ec4b9-3430-48f7-a0c8-75bb1fab291f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:09.956434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49aa1c-10d5-4fd7-8e85-2678f1c3a9e3 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:09.991850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c56488-2e68-4ea5-a461-d23175959823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:09.992576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c56488-2e68-4ea5-a461-d23175959823 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:09.992857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c56488-2e68-4ea5-a461-d23175959823 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:09.993133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c56488-2e68-4ea5-a461-d23175959823 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/f9988b9fef5c4d559b1918ffe040aaa8/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:09.996358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c56488-2e68-4ea5-a461-d23175959823 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=f9988b9fef5c4d559b1918ffe040aaa8, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:09.997834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c56488-2e68-4ea5-a461-d23175959823 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:10.036558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 379/769] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:14:09 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/f9988b9fef5c4d559b1918ffe040aaa8/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:14:10.037627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c56488-2e68-4ea5-a461-d23175959823 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:10.058273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 391/770] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:10.161409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256f73d-2edc-4778-9500-03a4443a16a6 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:10.161712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256f73d-2edc-4778-9500-03a4443a16a6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:10.161959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256f73d-2edc-4778-9500-03a4443a16a6 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:10.163567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 392/771] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:10.168558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22d040-05af-4925-87b4-26ccf77b761b None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:10.168838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22d040-05af-4925-87b4-26ccf77b761b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:10.169113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22d040-05af-4925-87b4-26ccf77b761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:10.188081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0f22d040-05af-4925-87b4-26ccf77b761b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:10.189361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0f22d040-05af-4925-87b4-26ccf77b761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:10.219386 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c56488-2e68-4ea5-a461-d23175959823 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:10.248578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:10.272556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a8fa-f033-4c07-93a9-b3d381e8a9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:10.273210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a8fa-f033-4c07-93a9-b3d381e8a9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:10.273492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a8fa-f033-4c07-93a9-b3d381e8a9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:10.273767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a8fa-f033-4c07-93a9-b3d381e8a9a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:10.293574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43a8fa-f033-4c07-93a9-b3d381e8a9a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-6c43a8fa-f033-4c07-93a9-b3d381e8a9a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:10.299913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:10.300894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:14:10.301743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:10.302933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 380/772] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:14:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:10.312291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a8fa-f033-4c07-93a9-b3d381e8a9a8 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:10.319298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 393/773] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:10.424718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a8fa-f033-4c07-93a9-b3d381e8a9a8 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:10.428321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22d040-05af-4925-87b4-26ccf77b761b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:10.444202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:10.476695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652336b9-1ed0-42aa-b7ac-fca9fc5dfa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:10.477637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652336b9-1ed0-42aa-b7ac-fca9fc5dfa51 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:10.478166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652336b9-1ed0-42aa-b7ac-fca9fc5dfa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:10.478628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652336b9-1ed0-42aa-b7ac-fca9fc5dfa51 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:10.480065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652336b9-1ed0-42aa-b7ac-fca9fc5dfa51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:10.480576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652336b9-1ed0-42aa-b7ac-fca9fc5dfa51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:10.483015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652336b9-1ed0-42aa-b7ac-fca9fc5dfa51 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:10.498346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 381/774] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:14:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:10.504028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652336b9-1ed0-42aa-b7ac-fca9fc5dfa51 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:10.562531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22d040-05af-4925-87b4-26ccf77b761b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:10.600946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:10.613287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f5385-1ca5-472d-be03-2bc1cec9ad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:10.613939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f5385-1ca5-472d-be03-2bc1cec9ad8f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:10.614218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f5385-1ca5-472d-be03-2bc1cec9ad8f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:10.614489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f5385-1ca5-472d-be03-2bc1cec9ad8f None admin] PATH_INFO: `/v3/services/network` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:10.615083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f5385-1ca5-472d-be03-2bc1cec9ad8f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:10.616497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f5385-1ca5-472d-be03-2bc1cec9ad8f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-b98f5385-1ca5-472d-be03-2bc1cec9ad8f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:10.632681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:10.633741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:14:10.634595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:10.635339 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 394/775] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:10 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:10.641894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f5385-1ca5-472d-be03-2bc1cec9ad8f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:10.724337 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652336b9-1ed0-42aa-b7ac-fca9fc5dfa51 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:10.737336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:10.764790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f5385-1ca5-472d-be03-2bc1cec9ad8f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:10.767920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987ded4-1306-48bc-ad1b-bbc3b462d957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:10.769082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987ded4-1306-48bc-ad1b-bbc3b462d957 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:10.770495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987ded4-1306-48bc-ad1b-bbc3b462d957 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:10.770947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987ded4-1306-48bc-ad1b-bbc3b462d957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:10.786141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987ded4-1306-48bc-ad1b-bbc3b462d957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:10.788002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987ded4-1306-48bc-ad1b-bbc3b462d957 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-8987ded4-1306-48bc-ad1b-bbc3b462d957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:10.808011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:10.809190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:10.810085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:10.810085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:10.810085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:10.810085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 382/776] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:10.810823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987ded4-1306-48bc-ad1b-bbc3b462d957 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:10.813709 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4938791-3bb9-4187-bbab-8be430593b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:10.816550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4938791-3bb9-4187-bbab-8be430593b82 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:10.817022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4938791-3bb9-4187-bbab-8be430593b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:10.817471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4938791-3bb9-4187-bbab-8be430593b82 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:10.818813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4938791-3bb9-4187-bbab-8be430593b82 None admin] RBAC: Adding query filter params (name=network) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:10.819297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4938791-3bb9-4187-bbab-8be430593b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:10.820920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4938791-3bb9-4187-bbab-8be430593b82 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:10.832483 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 395/777] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:10.834092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4938791-3bb9-4187-bbab-8be430593b82 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:10.928483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:10.940414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987ded4-1306-48bc-ad1b-bbc3b462d957 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:10.982428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f3102-e28e-4f8d-bf28-4fdcb2985206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:10.983499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f3102-e28e-4f8d-bf28-4fdcb2985206 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:10.983939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f3102-e28e-4f8d-bf28-4fdcb2985206 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:10.984210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f3102-e28e-4f8d-bf28-4fdcb2985206 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:10.984854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f3102-e28e-4f8d-bf28-4fdcb2985206 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:10.987102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f3102-e28e-4f8d-bf28-4fdcb2985206 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-fa9f3102-e28e-4f8d-bf28-4fdcb2985206 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:10.999017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:11.000048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:11.001325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 383/778] 10.222.0.49 () {56 vars in 1129 bytes} [Fri Sep 16 19:14:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:11.002127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f3102-e28e-4f8d-bf28-4fdcb2985206 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:11.109773 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4938791-3bb9-4187-bbab-8be430593b82 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:11.119048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f3102-e28e-4f8d-bf28-4fdcb2985206 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:11.154932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae40fb2-6aa2-4bf9-bd1d-5d09809f4614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:11.155649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40fb2-6aa2-4bf9-bd1d-5d09809f4614 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.156027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40fb2-6aa2-4bf9-bd1d-5d09809f4614 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.156307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40fb2-6aa2-4bf9-bd1d-5d09809f4614 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.156507 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c205-f55d-437a-aa77-3f4131bac7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:11.156974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae40fb2-6aa2-4bf9-bd1d-5d09809f4614 None admin] RBAC: Adding query filter params (type=network) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:11.157071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c205-f55d-437a-aa77-3f4131bac7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.157279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae40fb2-6aa2-4bf9-bd1d-5d09809f4614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:11.157374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c205-f55d-437a-aa77-3f4131bac7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.157742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c205-f55d-437a-aa77-3f4131bac7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.158728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae40fb2-6aa2-4bf9-bd1d-5d09809f4614 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:11.158833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c205-f55d-437a-aa77-3f4131bac7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:11.159035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c205-f55d-437a-aa77-3f4131bac7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:11.160417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c205-f55d-437a-aa77-3f4131bac7e9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:11.164592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 384/779] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:11.165529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39132043-27be-431f-b082-f9d5dbbbba0a None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.165814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39132043-27be-431f-b082-f9d5dbbbba0a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.166088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39132043-27be-431f-b082-f9d5dbbbba0a None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.167446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 385/780] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:11.167975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39132043-27be-431f-b082-f9d5dbbbba0a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:11.174471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:11.182556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 396/781] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:11.182556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c205-f55d-437a-aa77-3f4131bac7e9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:11.192267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:11.283427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c205-f55d-437a-aa77-3f4131bac7e9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:11.283636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39132043-27be-431f-b082-f9d5dbbbba0a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:11.319085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc082843-2343-4d6c-8dd0-9773c9b73932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:11.319697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082843-2343-4d6c-8dd0-9773c9b73932 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.320266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082843-2343-4d6c-8dd0-9773c9b73932 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.320266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082843-2343-4d6c-8dd0-9773c9b73932 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.320981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc082843-2343-4d6c-8dd0-9773c9b73932 None admin] RBAC: Adding query filter params (interface=public, service_id=3224a20d8af74fbc8faa4797ff121a4c, region_id=RegionOne) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:11.321288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc082843-2343-4d6c-8dd0-9773c9b73932 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:11.322669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc082843-2343-4d6c-8dd0-9773c9b73932 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:11.322800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b6e9d-29ba-436a-a113-1056a123d683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:11.323545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b6e9d-29ba-436a-a113-1056a123d683 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.323962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b6e9d-29ba-436a-a113-1056a123d683 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.324366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b6e9d-29ba-436a-a113-1056a123d683 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.325159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b6e9d-29ba-436a-a113-1056a123d683 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:11.325611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b6e9d-29ba-436a-a113-1056a123d683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:11.327120 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b6e9d-29ba-436a-a113-1056a123d683 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:11.330646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 397/782] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Sep 16 19:14:11 2022] GET /identity/v3/endpoints?service_id=3224a20d8af74fbc8faa4797ff121a4c&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:11.332031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2e985-eb04-48f9-9df2-b3522e357396 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.332316 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2e985-eb04-48f9-9df2-b3522e357396 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.332618 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2e985-eb04-48f9-9df2-b3522e357396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.341597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 386/783] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Sep 16 19:14:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:11.341597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b6e9d-29ba-436a-a113-1056a123d683 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:11.356429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-53a2e985-eb04-48f9-9df2-b3522e357396 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:11.357936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-53a2e985-eb04-48f9-9df2-b3522e357396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:11.426286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:11.430380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:11.440426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 398/784] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:11.441261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2e985-eb04-48f9-9df2-b3522e357396 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:11.453974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b6e9d-29ba-436a-a113-1056a123d683 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:11.503090 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889400f2-9d1f-4473-911a-4534ff4fd64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:11.503730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889400f2-9d1f-4473-911a-4534ff4fd64a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.504009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889400f2-9d1f-4473-911a-4534ff4fd64a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.504284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889400f2-9d1f-4473-911a-4534ff4fd64a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.514076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889400f2-9d1f-4473-911a-4534ff4fd64a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:11.516237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889400f2-9d1f-4473-911a-4534ff4fd64a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-889400f2-9d1f-4473-911a-4534ff4fd64a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:11.532703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:11.533678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:11.534618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:11.534618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:11.534618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:11.534618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:11.534618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:11.534618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:11.534618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:11.534618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:11.534618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:11.534618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:11.539321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 387/785] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Sep 16 19:14:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:11.540185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889400f2-9d1f-4473-911a-4534ff4fd64a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:11.565006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2e985-eb04-48f9-9df2-b3522e357396 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:11.600634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fec802-ba18-4284-8375-1383d2cbe927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:11.601594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fec802-ba18-4284-8375-1383d2cbe927 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.602103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fec802-ba18-4284-8375-1383d2cbe927 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.602558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fec802-ba18-4284-8375-1383d2cbe927 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.603386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fec802-ba18-4284-8375-1383d2cbe927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:11.604985 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fec802-ba18-4284-8375-1383d2cbe927 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:11.610680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 399/786] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Sep 16 19:14:11 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:11.611903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fec802-ba18-4284-8375-1383d2cbe927 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:11.678127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:11.680082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889400f2-9d1f-4473-911a-4534ff4fd64a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:11.723804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e4d54-82dd-441b-9fbd-1864e7826d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:11.724479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e4d54-82dd-441b-9fbd-1864e7826d34 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.724761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e4d54-82dd-441b-9fbd-1864e7826d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.725033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e4d54-82dd-441b-9fbd-1864e7826d34 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.725684 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e4d54-82dd-441b-9fbd-1864e7826d34 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:11.725989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e4d54-82dd-441b-9fbd-1864e7826d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:11.727401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e4d54-82dd-441b-9fbd-1864e7826d34 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:11.733513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fec802-ba18-4284-8375-1383d2cbe927 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:11.733708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 388/787] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Sep 16 19:14:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:11.734454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e4d54-82dd-441b-9fbd-1864e7826d34 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:11.744958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:11.785708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adfd7f-0876-44d5-9dd2-267f37e041b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:11.786347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adfd7f-0876-44d5-9dd2-267f37e041b3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.786629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adfd7f-0876-44d5-9dd2-267f37e041b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.786901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adfd7f-0876-44d5-9dd2-267f37e041b3 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.787656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adfd7f-0876-44d5-9dd2-267f37e041b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:11.787963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adfd7f-0876-44d5-9dd2-267f37e041b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:11.790617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adfd7f-0876-44d5-9dd2-267f37e041b3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:11.815700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 400/788] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Sep 16 19:14:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:11.816684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adfd7f-0876-44d5-9dd2-267f37e041b3 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:11.870388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e4d54-82dd-441b-9fbd-1864e7826d34 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:11.919465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f187723-d036-4956-99f0-df6c711c72ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:11.920238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f187723-d036-4956-99f0-df6c711c72ff None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.920551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f187723-d036-4956-99f0-df6c711c72ff None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.920827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f187723-d036-4956-99f0-df6c711c72ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.934026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f187723-d036-4956-99f0-df6c711c72ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-2f187723-d036-4956-99f0-df6c711c72ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:11.943174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:11.944779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:11.945850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 389/789] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:11.947116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f187723-d036-4956-99f0-df6c711c72ff None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:11.947766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adfd7f-0876-44d5-9dd2-267f37e041b3 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:11.968303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:11.989784 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a615d62-1c75-4c1a-920c-062821f7a50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:11.990927 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a615d62-1c75-4c1a-920c-062821f7a50a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:11.991585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a615d62-1c75-4c1a-920c-062821f7a50a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:11.992041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a615d62-1c75-4c1a-920c-062821f7a50a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:11.993621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a615d62-1c75-4c1a-920c-062821f7a50a None admin] RBAC: Adding query filter params (interface=public, service_id=f2c14f6268fc4a78a22703b2bc648657, region_id=RegionOne) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:11.994086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a615d62-1c75-4c1a-920c-062821f7a50a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:11.995860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a615d62-1c75-4c1a-920c-062821f7a50a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:12.007968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 401/790] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Sep 16 19:14:11 2022] GET /identity/v3/endpoints?service_id=f2c14f6268fc4a78a22703b2bc648657&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:12.007968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a615d62-1c75-4c1a-920c-062821f7a50a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:12.036121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:12.075653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f187723-d036-4956-99f0-df6c711c72ff None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:12.113612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be8e3c-9244-4855-b07d-16b3848c411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:12.114690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be8e3c-9244-4855-b07d-16b3848c411a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:12.115196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be8e3c-9244-4855-b07d-16b3848c411a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:12.115663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be8e3c-9244-4855-b07d-16b3848c411a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:12.116980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a615d62-1c75-4c1a-920c-062821f7a50a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:12.127591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be8e3c-9244-4855-b07d-16b3848c411a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:12.129513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be8e3c-9244-4855-b07d-16b3848c411a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-84be8e3c-9244-4855-b07d-16b3848c411a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:12.145339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:12.146336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:12.147239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:12.147239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:12.147239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:12.149109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 390/791] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:12.150179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be8e3c-9244-4855-b07d-16b3848c411a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:12.173055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6ec61-8062-4317-ac98-46ceaff32b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:12.174479 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6ec61-8062-4317-ac98-46ceaff32b01 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:12.175255 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6ec61-8062-4317-ac98-46ceaff32b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:12.175752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6ec61-8062-4317-ac98-46ceaff32b01 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:12.176891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6ec61-8062-4317-ac98-46ceaff32b01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:12.177421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6ec61-8062-4317-ac98-46ceaff32b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:12.179712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6ec61-8062-4317-ac98-46ceaff32b01 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:12.191777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 402/792] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:12.193912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6ec61-8062-4317-ac98-46ceaff32b01 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:12.251341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:12.273305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be8e3c-9244-4855-b07d-16b3848c411a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:12.293357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:12.315615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fcc94-edb1-46e8-9ced-0087afc3659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:12.316428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fcc94-edb1-46e8-9ced-0087afc3659c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:12.316724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fcc94-edb1-46e8-9ced-0087afc3659c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:12.316995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fcc94-edb1-46e8-9ced-0087afc3659c None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:12.317622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fcc94-edb1-46e8-9ced-0087afc3659c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:12.319577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fcc94-edb1-46e8-9ced-0087afc3659c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:12.332453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 391/793] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Sep 16 19:14:12 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:12.332453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fcc94-edb1-46e8-9ced-0087afc3659c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:12.348447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6ec61-8062-4317-ac98-46ceaff32b01 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:12.421225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f725c3e-82cd-4c48-9e8d-cf3adf937c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:12.421859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f725c3e-82cd-4c48-9e8d-cf3adf937c52 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:12.422135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f725c3e-82cd-4c48-9e8d-cf3adf937c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:12.422409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f725c3e-82cd-4c48-9e8d-cf3adf937c52 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:12.423255 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f725c3e-82cd-4c48-9e8d-cf3adf937c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:12.423889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f725c3e-82cd-4c48-9e8d-cf3adf937c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:12.426604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f725c3e-82cd-4c48-9e8d-cf3adf937c52 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:12.448152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 403/794] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:12.455073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639ee89-1cfe-4766-a4fb-5d8add874ce8 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:12.455410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639ee89-1cfe-4766-a4fb-5d8add874ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:12.455616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639ee89-1cfe-4766-a4fb-5d8add874ce8 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:12.457424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 404/795] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:12.460874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639ee89-1cfe-4766-a4fb-5d8add874ce8 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:12.503629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fcc94-edb1-46e8-9ced-0087afc3659c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:12.547267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2413ed4-2c34-46e8-88e9-c53919d6ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:12.547954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2413ed4-2c34-46e8-88e9-c53919d6ce9a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:12.548257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2413ed4-2c34-46e8-88e9-c53919d6ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:12.548546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2413ed4-2c34-46e8-88e9-c53919d6ce9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:12.559810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2413ed4-2c34-46e8-88e9-c53919d6ce9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:12.561342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2413ed4-2c34-46e8-88e9-c53919d6ce9a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-e2413ed4-2c34-46e8-88e9-c53919d6ce9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:12.577123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:12.580975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:12.581925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:12.581925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:12.581925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:12.581925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 392/796] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:12.581925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af865f-2e59-4ff7-bca9-063c4af9f96b None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:12.581925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af865f-2e59-4ff7-bca9-063c4af9f96b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:12.581925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af865f-2e59-4ff7-bca9-063c4af9f96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:12.591465 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639ee89-1cfe-4766-a4fb-5d8add874ce8 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:12.600445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-05af865f-2e59-4ff7-bca9-063c4af9f96b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:12.601643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-05af865f-2e59-4ff7-bca9-063c4af9f96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:12.608734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:12.629756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:12.630362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d32157-ea1c-4cff-ac54-09293af52fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:12.631532 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32157-ea1c-4cff-ac54-09293af52fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:12.631817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32157-ea1c-4cff-ac54-09293af52fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:12.632224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32157-ea1c-4cff-ac54-09293af52fc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:12.642223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d32157-ea1c-4cff-ac54-09293af52fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:12.643721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d32157-ea1c-4cff-ac54-09293af52fc4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-74d32157-ea1c-4cff-ac54-09293af52fc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:12.659111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:12.660249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:12.661516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:12.661516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:12.661516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:12.661516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:12.661516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:12.661516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:12.661516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:12.661516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:12.662680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 405/797] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:12.666055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d32157-ea1c-4cff-ac54-09293af52fc4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:12.674775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 393/798] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:12.681162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af865f-2e59-4ff7-bca9-063c4af9f96b None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:12.795362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d32157-ea1c-4cff-ac54-09293af52fc4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:12.834740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35cea2-ed28-4d9c-878a-596a9c66cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:12.835356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35cea2-ed28-4d9c-878a-596a9c66cd2f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:12.835683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35cea2-ed28-4d9c-878a-596a9c66cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:12.835957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35cea2-ed28-4d9c-878a-596a9c66cd2f None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:12.836674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35cea2-ed28-4d9c-878a-596a9c66cd2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:12.836979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35cea2-ed28-4d9c-878a-596a9c66cd2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:12.838650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35cea2-ed28-4d9c-878a-596a9c66cd2f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:12.853250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 406/799] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:12.859207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35cea2-ed28-4d9c-878a-596a9c66cd2f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:12.886594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:12.908187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af865f-2e59-4ff7-bca9-063c4af9f96b None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:12.974523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35cea2-ed28-4d9c-878a-596a9c66cd2f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:12.984040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f478a96-0606-4ec1-8522-db0c4fda57b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:12.984779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478a96-0606-4ec1-8522-db0c4fda57b5 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:12.985058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478a96-0606-4ec1-8522-db0c4fda57b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:12.985343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478a96-0606-4ec1-8522-db0c4fda57b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:12.986143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f478a96-0606-4ec1-8522-db0c4fda57b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:12.986503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f478a96-0606-4ec1-8522-db0c4fda57b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:12.987932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f478a96-0606-4ec1-8522-db0c4fda57b5 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:13.011821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10bd1f-ed71-4d3d-9eb1-fe866331bda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:13.012483 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10bd1f-ed71-4d3d-9eb1-fe866331bda5 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:13.012895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10bd1f-ed71-4d3d-9eb1-fe866331bda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:13.013167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10bd1f-ed71-4d3d-9eb1-fe866331bda5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:13.014546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 394/800] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:13.020716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f478a96-0606-4ec1-8522-db0c4fda57b5 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:13.020940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10bd1f-ed71-4d3d-9eb1-fe866331bda5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:13.022554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10bd1f-ed71-4d3d-9eb1-fe866331bda5 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-8c10bd1f-ed71-4d3d-9eb1-fe866331bda5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:13.035822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:13.038063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:13.040349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 407/801] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:13.048406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10bd1f-ed71-4d3d-9eb1-fe866331bda5 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:13.081652 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:13.136374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:13.157700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10bd1f-ed71-4d3d-9eb1-fe866331bda5 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:13.186321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f478a96-0606-4ec1-8522-db0c4fda57b5 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:13.194716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa821d2-600c-466d-923f-7700527a37d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:13.195340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa821d2-600c-466d-923f-7700527a37d4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:13.195615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa821d2-600c-466d-923f-7700527a37d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:13.195885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa821d2-600c-466d-923f-7700527a37d4 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:13.196658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa821d2-600c-466d-923f-7700527a37d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:13.196960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa821d2-600c-466d-923f-7700527a37d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:13.198489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa821d2-600c-466d-923f-7700527a37d4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:13.221643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 408/802] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Sep 16 19:14:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:13.222531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa821d2-600c-466d-923f-7700527a37d4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:13.230467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace5a17-ace5-447a-bd0b-6b0f41bea8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:13.231860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace5a17-ace5-447a-bd0b-6b0f41bea8c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:13.232316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace5a17-ace5-447a-bd0b-6b0f41bea8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:13.232756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace5a17-ace5-447a-bd0b-6b0f41bea8c5 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/df6eb4ca8ca1446e9bf49ce1ad73989c/roles/19d39213f2254bfab168b8c1148fd8db` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:13.254555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace5a17-ace5-447a-bd0b-6b0f41bea8c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=df6eb4ca8ca1446e9bf49ce1ad73989c, role_id=19d39213f2254bfab168b8c1148fd8db)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:13.256860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace5a17-ace5-447a-bd0b-6b0f41bea8c5 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:13.275610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 395/803] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:14:13 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/df6eb4ca8ca1446e9bf49ce1ad73989c/roles/19d39213f2254bfab168b8c1148fd8db => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:14:13.276660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace5a17-ace5-447a-bd0b-6b0f41bea8c5 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:13.408787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa821d2-600c-466d-923f-7700527a37d4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:13.454228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562ecd3-935f-4eee-b8a5-d29539652ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:13.456295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562ecd3-935f-4eee-b8a5-d29539652ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:13.456750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562ecd3-935f-4eee-b8a5-d29539652ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:13.457423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562ecd3-935f-4eee-b8a5-d29539652ad2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:13.467306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:13.473013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562ecd3-935f-4eee-b8a5-d29539652ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-0562ecd3-935f-4eee-b8a5-d29539652ad2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:13.480109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:13.481313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:13.482326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:13.483953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:13.487070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 409/804] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:13.494978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562ecd3-935f-4eee-b8a5-d29539652ad2 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:13.528106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace5a17-ace5-447a-bd0b-6b0f41bea8c5 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:13.566857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c44fb6-45eb-430c-b165-9bebf5a79ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:13.567502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c44fb6-45eb-430c-b165-9bebf5a79ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:13.567779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c44fb6-45eb-430c-b165-9bebf5a79ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:13.568048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c44fb6-45eb-430c-b165-9bebf5a79ab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:13.582713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c44fb6-45eb-430c-b165-9bebf5a79ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:13.584193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c44fb6-45eb-430c-b165-9bebf5a79ab1 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-07c44fb6-45eb-430c-b165-9bebf5a79ab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:13.606794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:13.607942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:13.608942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:13.608942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:13.608942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:13.608942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 396/805] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:13.614151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c44fb6-45eb-430c-b165-9bebf5a79ab1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:13.633272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562ecd3-935f-4eee-b8a5-d29539652ad2 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:13.682146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0474d2-a98e-4855-a73d-9c0e6d66af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:13.683223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0474d2-a98e-4855-a73d-9c0e6d66af5b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:13.684193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0474d2-a98e-4855-a73d-9c0e6d66af5b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:13.684655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0474d2-a98e-4855-a73d-9c0e6d66af5b None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:13.685722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0474d2-a98e-4855-a73d-9c0e6d66af5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:13.686171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0474d2-a98e-4855-a73d-9c0e6d66af5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:13.688884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0474d2-a98e-4855-a73d-9c0e6d66af5b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:13.701047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 410/806] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:13.709965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0474d2-a98e-4855-a73d-9c0e6d66af5b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:13.750391 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c44fb6-45eb-430c-b165-9bebf5a79ab1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:13.788894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:13.801572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:13.821471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9818ab-aff6-4af1-b85d-e34397cb4fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:13.822116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9818ab-aff6-4af1-b85d-e34397cb4fec None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:13.822690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9818ab-aff6-4af1-b85d-e34397cb4fec None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:13.822690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9818ab-aff6-4af1-b85d-e34397cb4fec None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:13.823312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9818ab-aff6-4af1-b85d-e34397cb4fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:13.823617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9818ab-aff6-4af1-b85d-e34397cb4fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:13.825043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9818ab-aff6-4af1-b85d-e34397cb4fec None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:13.835799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0474d2-a98e-4855-a73d-9c0e6d66af5b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:13.848185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 397/807] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:13.853391 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9818ab-aff6-4af1-b85d-e34397cb4fec None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:13.898070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1487e-1b88-492e-8619-0ed4db8d9dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:13.899229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1487e-1b88-492e-8619-0ed4db8d9dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:13.900456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1487e-1b88-492e-8619-0ed4db8d9dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:13.901520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1487e-1b88-492e-8619-0ed4db8d9dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:13.925708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1487e-1b88-492e-8619-0ed4db8d9dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:13.929918 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1487e-1b88-492e-8619-0ed4db8d9dd6 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-1dd1487e-1b88-492e-8619-0ed4db8d9dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:13.951854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:13.952839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:13.953826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:13.953826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:13.953826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:13.956048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 411/808] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:13.961702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1487e-1b88-492e-8619-0ed4db8d9dd6 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:14.073182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1487e-1b88-492e-8619-0ed4db8d9dd6 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:14.089424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:14.102637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9818ab-aff6-4af1-b85d-e34397cb4fec None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:14.111111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f924-3baf-41cc-bdd3-6c8162b052b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:14.112040 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f924-3baf-41cc-bdd3-6c8162b052b3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.112578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f924-3baf-41cc-bdd3-6c8162b052b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.113043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f924-3baf-41cc-bdd3-6c8162b052b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.113874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2f924-3baf-41cc-bdd3-6c8162b052b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:14.114364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2f924-3baf-41cc-bdd3-6c8162b052b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:14.116087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2f924-3baf-41cc-bdd3-6c8162b052b3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:14.129085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 412/809] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:14.134852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f924-3baf-41cc-bdd3-6c8162b052b3 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:14.179239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15989572-ef96-48fb-a298-4e07f779ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:14.179915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15989572-ef96-48fb-a298-4e07f779ef6e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.180196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15989572-ef96-48fb-a298-4e07f779ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.180504 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15989572-ef96-48fb-a298-4e07f779ef6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.187808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15989572-ef96-48fb-a298-4e07f779ef6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:14.189319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15989572-ef96-48fb-a298-4e07f779ef6e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-15989572-ef96-48fb-a298-4e07f779ef6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:14.201502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:14.212632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 398/810] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2cbea-da5a-4e1c-9a03-124718afa711 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.214883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2cbea-da5a-4e1c-9a03-124718afa711 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.219516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2cbea-da5a-4e1c-9a03-124718afa711 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.219516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 399/811] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:14.219516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2cbea-da5a-4e1c-9a03-124718afa711 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:14.259333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f924-3baf-41cc-bdd3-6c8162b052b3 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:14.261978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:14.300497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416d58-79cd-4d94-bc44-d4e5ef3df20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:14.301651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416d58-79cd-4d94-bc44-d4e5ef3df20e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.302198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416d58-79cd-4d94-bc44-d4e5ef3df20e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.302671 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416d58-79cd-4d94-bc44-d4e5ef3df20e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.310837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31416d58-79cd-4d94-bc44-d4e5ef3df20e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:14.312704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31416d58-79cd-4d94-bc44-d4e5ef3df20e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:14.318631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2cbea-da5a-4e1c-9a03-124718afa711 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-31416d58-79cd-4d94-bc44-d4e5ef3df20e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:14.326924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:14.327917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:14.328894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:14.328894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:14.328894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:14.328894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:14.328894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:14.328894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:14.328894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:14.328894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:14.328894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:14.328894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:14.336537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 413/812] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Sep 16 19:14:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:14.338230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0b26-bdce-447d-aa7c-1e75784595f3 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.338727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0b26-bdce-447d-aa7c-1e75784595f3 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.339194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0b26-bdce-447d-aa7c-1e75784595f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.354957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9889e4-2139-4218-a47f-077df0a288ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:14.355677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9889e4-2139-4218-a47f-077df0a288ce None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.355960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9889e4-2139-4218-a47f-077df0a288ce None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.356282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9889e4-2139-4218-a47f-077df0a288ce None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.356991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9889e4-2139-4218-a47f-077df0a288ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:14.357298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9889e4-2139-4218-a47f-077df0a288ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:14.358799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9889e4-2139-4218-a47f-077df0a288ce None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:14.361954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-2dcf0b26-bdce-447d-aa7c-1e75784595f3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:14.363364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2dcf0b26-bdce-447d-aa7c-1e75784595f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:14.372268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 400/813] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:14.373205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9889e4-2139-4218-a47f-077df0a288ce None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:14.398823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:14.443019 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 414/814] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:14.445095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf0b26-bdce-447d-aa7c-1e75784595f3 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:14.507666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9889e4-2139-4218-a47f-077df0a288ce None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:14.527168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:14.584467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd60f-0d2d-4ca5-9225-946c4bd7bbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:14.585960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd60f-0d2d-4ca5-9225-946c4bd7bbaf None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.588251 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf0b26-bdce-447d-aa7c-1e75784595f3 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:14.588768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd60f-0d2d-4ca5-9225-946c4bd7bbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.589237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd60f-0d2d-4ca5-9225-946c4bd7bbaf None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.590167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dd60f-0d2d-4ca5-9225-946c4bd7bbaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:14.590682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dd60f-0d2d-4ca5-9225-946c4bd7bbaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:14.592309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dd60f-0d2d-4ca5-9225-946c4bd7bbaf None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:14.630671 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9555d-9988-47a3-a135-6979f7c26992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:14.631714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9555d-9988-47a3-a135-6979f7c26992 None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.632208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9555d-9988-47a3-a135-6979f7c26992 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.632790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9555d-9988-47a3-a135-6979f7c26992 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/94828db5fc064a539b5b7b17cac1602b/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.634917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9555d-9988-47a3-a135-6979f7c26992 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=94828db5fc064a539b5b7b17cac1602b, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:14.636705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9555d-9988-47a3-a135-6979f7c26992 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:14.652470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 401/815] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Sep 16 19:14:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:14.655904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd60f-0d2d-4ca5-9225-946c4bd7bbaf None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:14.658593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 415/816] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:14:14 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/94828db5fc064a539b5b7b17cac1602b/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:14:14.781490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9555d-9988-47a3-a135-6979f7c26992 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:14.814799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd60f-0d2d-4ca5-9225-946c4bd7bbaf None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:14.839569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:14.859837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a6051-3bf1-4326-83e9-3bc3064ec12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:14.861841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6051-3bf1-4326-83e9-3bc3064ec12f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.862124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6051-3bf1-4326-83e9-3bc3064ec12f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.862397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6051-3bf1-4326-83e9-3bc3064ec12f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.902241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:14.933719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9555d-9988-47a3-a135-6979f7c26992 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:14.945717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a6051-3bf1-4326-83e9-3bc3064ec12f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:14.947463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a6051-3bf1-4326-83e9-3bc3064ec12f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:14.976753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0858c-e7c1-4e78-9f58-5aff5f7698a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:14.977395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0858c-e7c1-4e78-9f58-5aff5f7698a1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.977670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0858c-e7c1-4e78-9f58-5aff5f7698a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.978185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0858c-e7c1-4e78-9f58-5aff5f7698a1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.978788 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0858c-e7c1-4e78-9f58-5aff5f7698a1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:14.980899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0858c-e7c1-4e78-9f58-5aff5f7698a1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-f6b0858c-e7c1-4e78-9f58-5aff5f7698a1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:14.992712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:14.993732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:14.994568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 416/817] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:14 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:14.995869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776a2bb-59a5-4fa2-b7b6-af7fbd906c2e None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:14.995869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776a2bb-59a5-4fa2-b7b6-af7fbd906c2e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:14.996106 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776a2bb-59a5-4fa2-b7b6-af7fbd906c2e None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:14.997971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 417/818] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:15.000111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776a2bb-59a5-4fa2-b7b6-af7fbd906c2e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:15.065451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 402/819] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:14:15.067364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4fba-4ae2-4d62-9c91-565088ce6985 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:15.067818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4fba-4ae2-4d62-9c91-565088ce6985 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:15.068594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4fba-4ae2-4d62-9c91-565088ce6985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:15.088998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-04fd4fba-4ae2-4d62-9c91-565088ce6985 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:15.090435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-04fd4fba-4ae2-4d62-9c91-565088ce6985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:15.114938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:15.133795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776a2bb-59a5-4fa2-b7b6-af7fbd906c2e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:15.164738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:15.169973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cf8b8-c1dc-410e-b3ed-2aa390c1c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:15.170869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf8b8-c1dc-410e-b3ed-2aa390c1c58f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:15.171385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf8b8-c1dc-410e-b3ed-2aa390c1c58f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:15.171868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf8b8-c1dc-410e-b3ed-2aa390c1c58f None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:15.172898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cf8b8-c1dc-410e-b3ed-2aa390c1c58f None admin] RBAC: Adding query filter params (name=network) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:15.173439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cf8b8-c1dc-410e-b3ed-2aa390c1c58f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:15.174884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 403/820] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:15.175311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cf8b8-c1dc-410e-b3ed-2aa390c1c58f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:15.175712 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd4fba-4ae2-4d62-9c91-565088ce6985 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:15.181151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 418/821] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:15.192436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cf8b8-c1dc-410e-b3ed-2aa390c1c58f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:15.284000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd4fba-4ae2-4d62-9c91-565088ce6985 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:15.321348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298084e-0847-4278-9a14-2af3c5ac6a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:15.321895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298084e-0847-4278-9a14-2af3c5ac6a06 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:15.322172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298084e-0847-4278-9a14-2af3c5ac6a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:15.322447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298084e-0847-4278-9a14-2af3c5ac6a06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:15.333152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298084e-0847-4278-9a14-2af3c5ac6a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:15.335013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298084e-0847-4278-9a14-2af3c5ac6a06 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-3298084e-0847-4278-9a14-2af3c5ac6a06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:15.372036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:15.373308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:15.374258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:15.374258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:15.374258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:15.377968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 404/822] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:15.383194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298084e-0847-4278-9a14-2af3c5ac6a06 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:15.430642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cf8b8-c1dc-410e-b3ed-2aa390c1c58f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:15.468711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:15.479800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5055a-9e28-4eaf-8a79-84b4627f45c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:15.480450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5055a-9e28-4eaf-8a79-84b4627f45c0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:15.480737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5055a-9e28-4eaf-8a79-84b4627f45c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:15.481009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5055a-9e28-4eaf-8a79-84b4627f45c0 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:15.481660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5055a-9e28-4eaf-8a79-84b4627f45c0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:15.481943 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5055a-9e28-4eaf-8a79-84b4627f45c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:15.483317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5055a-9e28-4eaf-8a79-84b4627f45c0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:15.489298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 419/823] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:15.490119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5055a-9e28-4eaf-8a79-84b4627f45c0 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:15.509176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:15.550130 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298084e-0847-4278-9a14-2af3c5ac6a06 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:15.598744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ece49-e949-4847-89e3-833a1d442252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:15.600012 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5055a-9e28-4eaf-8a79-84b4627f45c0 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:15.600182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ece49-e949-4847-89e3-833a1d442252 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:15.600676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ece49-e949-4847-89e3-833a1d442252 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:15.601082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ece49-e949-4847-89e3-833a1d442252 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:15.602141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ece49-e949-4847-89e3-833a1d442252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:15.603447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ece49-e949-4847-89e3-833a1d442252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:15.605027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ece49-e949-4847-89e3-833a1d442252 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:15.639800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0e23-7764-4a52-af4c-5c5fb3550704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:15.640487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0e23-7764-4a52-af4c-5c5fb3550704 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:15.640766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0e23-7764-4a52-af4c-5c5fb3550704 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:15.641036 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0e23-7764-4a52-af4c-5c5fb3550704 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:15.641697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0e23-7764-4a52-af4c-5c5fb3550704 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:15.643900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0e23-7764-4a52-af4c-5c5fb3550704 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-3b2c0e23-7764-4a52-af4c-5c5fb3550704 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:15.653938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:15.655197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:14:15.656074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:15.661114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 420/824] 10.222.0.49 () {56 vars in 1129 bytes} [Fri Sep 16 19:14:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:15.662128 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0e23-7764-4a52-af4c-5c5fb3550704 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:15.768916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 405/825] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:15.769941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ece49-e949-4847-89e3-833a1d442252 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:15.777801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:15.800487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0e23-7764-4a52-af4c-5c5fb3550704 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:15.837148 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88648b7c-f608-4c82-a382-953e28b3f503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:15.837756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88648b7c-f608-4c82-a382-953e28b3f503 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:15.838030 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88648b7c-f608-4c82-a382-953e28b3f503 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:15.838297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88648b7c-f608-4c82-a382-953e28b3f503 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:15.839000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88648b7c-f608-4c82-a382-953e28b3f503 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:15.840369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88648b7c-f608-4c82-a382-953e28b3f503 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:15.865075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 421/826] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:14:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:15.865914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88648b7c-f608-4c82-a382-953e28b3f503 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:15.898629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ece49-e949-4847-89e3-833a1d442252 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:15.908233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:15.964512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7317c3-52e3-4358-b485-193bcb52abb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:15.965409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7317c3-52e3-4358-b485-193bcb52abb4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:15.965883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7317c3-52e3-4358-b485-193bcb52abb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:15.966327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7317c3-52e3-4358-b485-193bcb52abb4 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:15.967375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7317c3-52e3-4358-b485-193bcb52abb4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:15.967862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7317c3-52e3-4358-b485-193bcb52abb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:15.970764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7317c3-52e3-4358-b485-193bcb52abb4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:15.977831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 406/827] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Sep 16 19:14:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:15.979459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed56de-f025-4ca6-b51a-62e0d25f0a77 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:15.980646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed56de-f025-4ca6-b51a-62e0d25f0a77 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:15.981069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed56de-f025-4ca6-b51a-62e0d25f0a77 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:15.988054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 407/828] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:15.989560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed56de-f025-4ca6-b51a-62e0d25f0a77 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:16.015141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88648b7c-f608-4c82-a382-953e28b3f503 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:16.058769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6af80-51a1-467e-a93e-d3b1d5c7ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:16.059441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6af80-51a1-467e-a93e-d3b1d5c7ce5b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:16.059715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6af80-51a1-467e-a93e-d3b1d5c7ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:16.059980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6af80-51a1-467e-a93e-d3b1d5c7ce5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:16.063585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:16.070843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6af80-51a1-467e-a93e-d3b1d5c7ce5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:16.072416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6af80-51a1-467e-a93e-d3b1d5c7ce5b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-6da6af80-51a1-467e-a93e-d3b1d5c7ce5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:16.087283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:16.088244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:16.089180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:16.089180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:16.089180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:16.089180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:16.089180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:16.089180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:16.089180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:16.089180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:16.089180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 422/829] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:16.091166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab688f8-7688-4d0c-8737-e97d01f18d13 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:16.091166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab688f8-7688-4d0c-8737-e97d01f18d13 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:16.091166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab688f8-7688-4d0c-8737-e97d01f18d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:16.113910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-fab688f8-7688-4d0c-8737-e97d01f18d13 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:16.115156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-fab688f8-7688-4d0c-8737-e97d01f18d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:16.141665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed56de-f025-4ca6-b51a-62e0d25f0a77 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:16.181569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab0d37-ab9c-4dbd-993c-974e93cc0e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:16.182192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0d37-ab9c-4dbd-993c-974e93cc0e2e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:16.182464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0d37-ab9c-4dbd-993c-974e93cc0e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:16.182729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0d37-ab9c-4dbd-993c-974e93cc0e2e None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:16.183354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab0d37-ab9c-4dbd-993c-974e93cc0e2e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:16.183649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab0d37-ab9c-4dbd-993c-974e93cc0e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:16.185051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab0d37-ab9c-4dbd-993c-974e93cc0e2e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:16.191036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 408/830] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Sep 16 19:14:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:16.191848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab0d37-ab9c-4dbd-993c-974e93cc0e2e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:16.199914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 423/831] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:16.201292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab688f8-7688-4d0c-8737-e97d01f18d13 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:16.225234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:16.313001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab0d37-ab9c-4dbd-993c-974e93cc0e2e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:16.318930 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab688f8-7688-4d0c-8737-e97d01f18d13 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:16.353593 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f15bb-83c6-45e1-bf92-9f1026824daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:16.353809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:16.355178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f15bb-83c6-45e1-bf92-9f1026824daf None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:16.355702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f15bb-83c6-45e1-bf92-9f1026824daf None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:16.356241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f15bb-83c6-45e1-bf92-9f1026824daf None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:16.357264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f15bb-83c6-45e1-bf92-9f1026824daf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:16.357925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f15bb-83c6-45e1-bf92-9f1026824daf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:16.360359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f15bb-83c6-45e1-bf92-9f1026824daf None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:16.364705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618637-d28a-4ac2-a896-e8fa9cf52b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:16.365444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618637-d28a-4ac2-a896-e8fa9cf52b7f None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:16.365671 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618637-d28a-4ac2-a896-e8fa9cf52b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:16.365949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618637-d28a-4ac2-a896-e8fa9cf52b7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:16.366627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb618637-d28a-4ac2-a896-e8fa9cf52b7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:16.368013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb618637-d28a-4ac2-a896-e8fa9cf52b7f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:16.375542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 409/832] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:16.384430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f15bb-83c6-45e1-bf92-9f1026824daf None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:16.398556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 424/833] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:14:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:16.492411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618637-d28a-4ac2-a896-e8fa9cf52b7f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:16.507457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:16.520305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f15bb-83c6-45e1-bf92-9f1026824daf None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:16.566182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf22e1-99a5-45f2-9977-b3ad5ffa9bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:16.566804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf22e1-99a5-45f2-9977-b3ad5ffa9bda None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:16.567089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf22e1-99a5-45f2-9977-b3ad5ffa9bda None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:16.567363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf22e1-99a5-45f2-9977-b3ad5ffa9bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:16.568465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf22e1-99a5-45f2-9977-b3ad5ffa9bda None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=f9988b9fef5c4d559b1918ffe040aaa8) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:16.568800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf22e1-99a5-45f2-9977-b3ad5ffa9bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:16.570265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf22e1-99a5-45f2-9977-b3ad5ffa9bda None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:16.577359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 410/834] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:16 2022] GET /identity/v3/role_assignments?user.id=f9988b9fef5c4d559b1918ffe040aaa8&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=71bed99a52684ba990097719b40ef99d => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:16.626136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618637-d28a-4ac2-a896-e8fa9cf52b7f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:16.665809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ebc8b-66cf-4300-962e-0a2990f1c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:16.666834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ebc8b-66cf-4300-962e-0a2990f1c80f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:16.667326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ebc8b-66cf-4300-962e-0a2990f1c80f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:16.667602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ebc8b-66cf-4300-962e-0a2990f1c80f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:16.681289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ebc8b-66cf-4300-962e-0a2990f1c80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-4d9ebc8b-66cf-4300-962e-0a2990f1c80f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:16.686900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:16.687898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:14:16.688849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:16.693818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 425/835] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:14:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:16.697551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf22e1-99a5-45f2-9977-b3ad5ffa9bda None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:16.809981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf22e1-99a5-45f2-9977-b3ad5ffa9bda None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:16.846430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0e420-04d0-45fe-9c78-6253e0bd27b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:16.847360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0e420-04d0-45fe-9c78-6253e0bd27b5 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:16.847809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0e420-04d0-45fe-9c78-6253e0bd27b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:16.848248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0e420-04d0-45fe-9c78-6253e0bd27b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:16.849136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0e420-04d0-45fe-9c78-6253e0bd27b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:16.849624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0e420-04d0-45fe-9c78-6253e0bd27b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:16.851149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0e420-04d0-45fe-9c78-6253e0bd27b5 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:16.866168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 411/836] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:14:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:16.867825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ebc8b-66cf-4300-962e-0a2990f1c80f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:16.914205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:16.980586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ebc8b-66cf-4300-962e-0a2990f1c80f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:17.020136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d68ba-1315-43ba-9f61-eb33e9f72eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:17.021171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d68ba-1315-43ba-9f61-eb33e9f72eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:17.021629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d68ba-1315-43ba-9f61-eb33e9f72eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:17.022112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d68ba-1315-43ba-9f61-eb33e9f72eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:17.035385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d68ba-1315-43ba-9f61-eb33e9f72eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:17.037225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d68ba-1315-43ba-9f61-eb33e9f72eb8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-2a6d68ba-1315-43ba-9f61-eb33e9f72eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:17.053000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:17.054002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:17.054926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:17.054926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:17.054926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:17.056821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 426/837] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:17.062482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0e420-04d0-45fe-9c78-6253e0bd27b5 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:17.078681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:17.133467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd175be-8831-416d-8de6-bdc76ffa5170 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:17.133745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd175be-8831-416d-8de6-bdc76ffa5170 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:17.134024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd175be-8831-416d-8de6-bdc76ffa5170 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:17.135666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 427/838] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:17.140805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1348-5563-4803-981d-e7a0a379d4a1 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:17.141089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1348-5563-4803-981d-e7a0a379d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:17.141444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1348-5563-4803-981d-e7a0a379d4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:17.162561 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-06bc1348-5563-4803-981d-e7a0a379d4a1 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:17.163816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-06bc1348-5563-4803-981d-e7a0a379d4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:17.182296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0e420-04d0-45fe-9c78-6253e0bd27b5 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:17.221219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579d2f-f765-472b-878f-e1212b8130a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:17.222029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579d2f-f765-472b-878f-e1212b8130a4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:17.222407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579d2f-f765-472b-878f-e1212b8130a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:17.222780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579d2f-f765-472b-878f-e1212b8130a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:17.223535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85579d2f-f765-472b-878f-e1212b8130a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:17.224061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85579d2f-f765-472b-878f-e1212b8130a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:17.225654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85579d2f-f765-472b-878f-e1212b8130a4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:17.238770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 412/839] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:17.244000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579d2f-f765-472b-878f-e1212b8130a4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:17.249962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 428/840] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:17.328776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:17.348255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579d2f-f765-472b-878f-e1212b8130a4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:17.383100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2e23c-5ab0-46c6-984a-33367d505f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:17.383738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2e23c-5ab0-46c6-984a-33367d505f39 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:17.384012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2e23c-5ab0-46c6-984a-33367d505f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:17.384275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2e23c-5ab0-46c6-984a-33367d505f39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:17.393444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2e23c-5ab0-46c6-984a-33367d505f39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:17.394944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2e23c-5ab0-46c6-984a-33367d505f39 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-c9e2e23c-5ab0-46c6-984a-33367d505f39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:17.408418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:17.409453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:17.410430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:17.410430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:17.410430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:17.410430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:17.410430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:17.410430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:17.410430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:17.410430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:17.410430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:17.410430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:17.414338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 413/841] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Sep 16 19:14:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:17.415721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc1348-5563-4803-981d-e7a0a379d4a1 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:17.441359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:17.518548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc1348-5563-4803-981d-e7a0a379d4a1 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:17.535054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2e23c-5ab0-46c6-984a-33367d505f39 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:17.554319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbeb2d-ff79-45bc-b182-58445fc37216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:17.555274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbeb2d-ff79-45bc-b182-58445fc37216 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:17.555748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbeb2d-ff79-45bc-b182-58445fc37216 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:17.556024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbeb2d-ff79-45bc-b182-58445fc37216 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:17.556839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbeb2d-ff79-45bc-b182-58445fc37216 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:17.557149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbeb2d-ff79-45bc-b182-58445fc37216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:17.558659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbeb2d-ff79-45bc-b182-58445fc37216 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:17.579382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 429/842] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Sep 16 19:14:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:17.585340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbeb2d-ff79-45bc-b182-58445fc37216 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:17.652758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2e23c-5ab0-46c6-984a-33367d505f39 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:17.672784 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:17.690080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:17.696431 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbeb2d-ff79-45bc-b182-58445fc37216 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:17.697958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc0ffd-05ca-4a85-b87f-7a496f393b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:17.699287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc0ffd-05ca-4a85-b87f-7a496f393b29 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:17.699811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc0ffd-05ca-4a85-b87f-7a496f393b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:17.700276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc0ffd-05ca-4a85-b87f-7a496f393b29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:17.712843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc0ffd-05ca-4a85-b87f-7a496f393b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-50bc0ffd-05ca-4a85-b87f-7a496f393b29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:17.718994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:17.720074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:17.721099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:17.723615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 414/843] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:17.729308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc0ffd-05ca-4a85-b87f-7a496f393b29 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:17.741591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a739ec6-7b99-4d44-b8ea-4de8ba0f4628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:17.742941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a739ec6-7b99-4d44-b8ea-4de8ba0f4628 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:17.743840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a739ec6-7b99-4d44-b8ea-4de8ba0f4628 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:17.744320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a739ec6-7b99-4d44-b8ea-4de8ba0f4628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:17.836595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a739ec6-7b99-4d44-b8ea-4de8ba0f4628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:17.839219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a739ec6-7b99-4d44-b8ea-4de8ba0f4628 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:17.847877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc0ffd-05ca-4a85-b87f-7a496f393b29 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:17.885906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967272c-8198-4ed6-b7af-b29ce3008859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:17.886705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967272c-8198-4ed6-b7af-b29ce3008859 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:17.887065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967272c-8198-4ed6-b7af-b29ce3008859 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:17.887419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967272c-8198-4ed6-b7af-b29ce3008859 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:17.888149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967272c-8198-4ed6-b7af-b29ce3008859 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:17.888558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967272c-8198-4ed6-b7af-b29ce3008859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:17.890244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967272c-8198-4ed6-b7af-b29ce3008859 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:17.901656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 415/844] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:17.910208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967272c-8198-4ed6-b7af-b29ce3008859 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:17.950241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:17.973516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:17.982873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 430/845] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 19:14:17.990390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a739ec6-7b99-4d44-b8ea-4de8ba0f4628 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:18.030700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967272c-8198-4ed6-b7af-b29ce3008859 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:18.068352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59774c-4463-47e4-8138-6c7a317e3309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:18.069390 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59774c-4463-47e4-8138-6c7a317e3309 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.069881 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59774c-4463-47e4-8138-6c7a317e3309 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.070251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59774c-4463-47e4-8138-6c7a317e3309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.080679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59774c-4463-47e4-8138-6c7a317e3309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:18.082280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59774c-4463-47e4-8138-6c7a317e3309 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-7f59774c-4463-47e4-8138-6c7a317e3309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:18.097486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:18.098620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:18.099724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:18.099724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:18.099724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:18.105505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 416/846] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:18.106964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59774c-4463-47e4-8138-6c7a317e3309 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:18.116680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a739ec6-7b99-4d44-b8ea-4de8ba0f4628 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:18.157735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e558b8f-f408-4e95-a0c2-2217e4342ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:18.159160 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e558b8f-f408-4e95-a0c2-2217e4342ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.159657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e558b8f-f408-4e95-a0c2-2217e4342ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.160526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e558b8f-f408-4e95-a0c2-2217e4342ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.174603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e558b8f-f408-4e95-a0c2-2217e4342ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:18.177287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e558b8f-f408-4e95-a0c2-2217e4342ae2 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-1e558b8f-f408-4e95-a0c2-2217e4342ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:18.197095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:18.198070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:18.198952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:18.198952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:18.198952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:18.201028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 431/847] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:18.206642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e558b8f-f408-4e95-a0c2-2217e4342ae2 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:18.226396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59774c-4463-47e4-8138-6c7a317e3309 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:18.235699 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:18.256179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:18.266652 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbc739-04b9-4627-b9d4-8a9560ef4b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:18.267272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc739-04b9-4627-b9d4-8a9560ef4b12 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.267546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc739-04b9-4627-b9d4-8a9560ef4b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.267812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc739-04b9-4627-b9d4-8a9560ef4b12 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.268543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbc739-04b9-4627-b9d4-8a9560ef4b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:18.268843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbc739-04b9-4627-b9d4-8a9560ef4b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:18.270265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbc739-04b9-4627-b9d4-8a9560ef4b12 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:18.287537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 417/848] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:18.288628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbc739-04b9-4627-b9d4-8a9560ef4b12 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:18.353416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e558b8f-f408-4e95-a0c2-2217e4342ae2 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:18.400176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbc739-04b9-4627-b9d4-8a9560ef4b12 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:18.400703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e0b7a-5352-4754-aaed-f133cc038b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:18.401478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0b7a-5352-4754-aaed-f133cc038b57 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.402146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0b7a-5352-4754-aaed-f133cc038b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.402558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0b7a-5352-4754-aaed-f133cc038b57 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.404252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e0b7a-5352-4754-aaed-f133cc038b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:18.404717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e0b7a-5352-4754-aaed-f133cc038b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:18.406252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e0b7a-5352-4754-aaed-f133cc038b57 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:18.423433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 432/849] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:18.429787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e0b7a-5352-4754-aaed-f133cc038b57 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:18.442011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1dcd8-94c2-4854-9d8e-8fcab0bf369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:18.442591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1dcd8-94c2-4854-9d8e-8fcab0bf369a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.442938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1dcd8-94c2-4854-9d8e-8fcab0bf369a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.443615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1dcd8-94c2-4854-9d8e-8fcab0bf369a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.451191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1dcd8-94c2-4854-9d8e-8fcab0bf369a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:18.452663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1dcd8-94c2-4854-9d8e-8fcab0bf369a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-bdd1dcd8-94c2-4854-9d8e-8fcab0bf369a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:18.464762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:18.465783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:18.466802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:18.466802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:18.466802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:18.466802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:18.466802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:18.466802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:18.466802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:18.466802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:18.466802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:14:18.466802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:18.470856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 418/850] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:18.472155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1dcd8-94c2-4854-9d8e-8fcab0bf369a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:18.502125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:18.564000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:18.574118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e0b7a-5352-4754-aaed-f133cc038b57 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:18.583797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1dcd8-94c2-4854-9d8e-8fcab0bf369a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:18.619179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303b8ba-ed78-4eb4-970a-24e015e9ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:18.620122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303b8ba-ed78-4eb4-970a-24e015e9ecb0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.620641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303b8ba-ed78-4eb4-970a-24e015e9ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.621043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa30d2-490b-4635-a59e-45b59bc2afed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:18.621279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303b8ba-ed78-4eb4-970a-24e015e9ecb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.621775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa30d2-490b-4635-a59e-45b59bc2afed None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.622169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa30d2-490b-4635-a59e-45b59bc2afed None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.622508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa30d2-490b-4635-a59e-45b59bc2afed None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.623301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa30d2-490b-4635-a59e-45b59bc2afed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:18.623663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa30d2-490b-4635-a59e-45b59bc2afed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:18.625419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa30d2-490b-4635-a59e-45b59bc2afed None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:18.631198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303b8ba-ed78-4eb4-970a-24e015e9ecb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:18.633013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303b8ba-ed78-4eb4-970a-24e015e9ecb0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-8303b8ba-ed78-4eb4-970a-24e015e9ecb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:18.648697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:18.649660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:18.650539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:18.650539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:18.650539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:18.650539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:18.650539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:18.650539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:18.650539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:18.650539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:18.652199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 419/851] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Sep 16 19:14:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:18.653278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 433/852] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:18.653852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa30d2-490b-4635-a59e-45b59bc2afed None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:18.660736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303b8ba-ed78-4eb4-970a-24e015e9ecb0 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:18.774617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:18.791025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303b8ba-ed78-4eb4-970a-24e015e9ecb0 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:18.794686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa30d2-490b-4635-a59e-45b59bc2afed None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:18.828465 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f7d23-eecd-4718-8997-1ffb7d05fab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:18.829131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7d23-eecd-4718-8997-1ffb7d05fab3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.829405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7d23-eecd-4718-8997-1ffb7d05fab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.829675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7d23-eecd-4718-8997-1ffb7d05fab3 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.830363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f7d23-eecd-4718-8997-1ffb7d05fab3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:18.830669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f7d23-eecd-4718-8997-1ffb7d05fab3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:18.832096 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f7d23-eecd-4718-8997-1ffb7d05fab3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:18.835815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd83603-5e19-473b-b708-1b2ffdc7a3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:18.836463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83603-5e19-473b-b708-1b2ffdc7a3ce None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.836744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83603-5e19-473b-b708-1b2ffdc7a3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.837013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83603-5e19-473b-b708-1b2ffdc7a3ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.844599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 434/853] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:18.846982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda3c39-5b75-4387-b0dd-1127f97166eb None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.847807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda3c39-5b75-4387-b0dd-1127f97166eb None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.848184 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda3c39-5b75-4387-b0dd-1127f97166eb None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.849697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 435/854] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:18.850966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda3c39-5b75-4387-b0dd-1127f97166eb None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:18.869280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:18.910563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd83603-5e19-473b-b708-1b2ffdc7a3ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:18.912010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd83603-5e19-473b-b708-1b2ffdc7a3ce None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:18.960200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda3c39-5b75-4387-b0dd-1127f97166eb None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:18.993571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e785982-43aa-4375-ac31-1ae219851ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:18.994175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785982-43aa-4375-ac31-1ae219851ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:18.994446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785982-43aa-4375-ac31-1ae219851ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:18.994716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785982-43aa-4375-ac31-1ae219851ec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:18.994983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:18.995437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e785982-43aa-4375-ac31-1ae219851ec3 None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=df6eb4ca8ca1446e9bf49ce1ad73989c) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:18.995742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e785982-43aa-4375-ac31-1ae219851ec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:18.997326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e785982-43aa-4375-ac31-1ae219851ec3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:19.003385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 436/855] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:18 2022] GET /identity/v3/role_assignments?user.id=df6eb4ca8ca1446e9bf49ce1ad73989c&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:19.004617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbcbb2-5d6b-4838-8e71-1326207a2b82 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.004823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbcbb2-5d6b-4838-8e71-1326207a2b82 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.005090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbcbb2-5d6b-4838-8e71-1326207a2b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.013034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 420/856] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:14:19.014392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeefcb-65da-44b1-b223-cf2ea499d4cd None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.014676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeefcb-65da-44b1-b223-cf2ea499d4cd None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.014948 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeefcb-65da-44b1-b223-cf2ea499d4cd None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.016564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 421/857] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:19.021681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeefcb-65da-44b1-b223-cf2ea499d4cd None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:19.032055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-cdcbcbb2-5d6b-4838-8e71-1326207a2b82 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:19.033388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cdcbcbb2-5d6b-4838-8e71-1326207a2b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:19.125953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 437/858] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:19.127035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cbf3-ccd3-4b1d-b40b-0ed0cf3b0234 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.127317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cbf3-ccd3-4b1d-b40b-0ed0cf3b0234 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.127586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cbf3-ccd3-4b1d-b40b-0ed0cf3b0234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.148805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-20a6cbf3-ccd3-4b1d-b40b-0ed0cf3b0234 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:19.150014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-20a6cbf3-ccd3-4b1d-b40b-0ed0cf3b0234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:19.152421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:19.171160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeefcb-65da-44b1-b223-cf2ea499d4cd None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:19.221629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf39f08-3f68-45b2-8a97-702826453d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:19.222680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf39f08-3f68-45b2-8a97-702826453d4d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.223026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf39f08-3f68-45b2-8a97-702826453d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.223369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf39f08-3f68-45b2-8a97-702826453d4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.228662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 438/859] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:19.238434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf39f08-3f68-45b2-8a97-702826453d4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:19.240203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf39f08-3f68-45b2-8a97-702826453d4d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-dcf39f08-3f68-45b2-8a97-702826453d4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:19.256849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:19.257929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:19.258922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:19.258922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:19.258922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:19.259405 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 422/860] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:19.265184 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6cbf3-ccd3-4b1d-b40b-0ed0cf3b0234 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:19.374640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6cbf3-ccd3-4b1d-b40b-0ed0cf3b0234 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:19.409891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a1504-0fef-4135-ba0f-393ff081a5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:19.410552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a1504-0fef-4135-ba0f-393ff081a5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.410828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a1504-0fef-4135-ba0f-393ff081a5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.411094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a1504-0fef-4135-ba0f-393ff081a5a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.411789 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a1504-0fef-4135-ba0f-393ff081a5a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:19.412093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a1504-0fef-4135-ba0f-393ff081a5a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:19.413543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a1504-0fef-4135-ba0f-393ff081a5a1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:19.420361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:19.420770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf39f08-3f68-45b2-8a97-702826453d4d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:19.428195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 439/861] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:19.433709 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a1504-0fef-4135-ba0f-393ff081a5a1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:19.466542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:19.537885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf39f08-3f68-45b2-8a97-702826453d4d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:19.548538 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a1504-0fef-4135-ba0f-393ff081a5a1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:19.574552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8a550-7996-43d8-b20b-391f74ef668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:19.575559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8a550-7996-43d8-b20b-391f74ef668a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.576037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8a550-7996-43d8-b20b-391f74ef668a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.576624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8a550-7996-43d8-b20b-391f74ef668a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.577411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8a550-7996-43d8-b20b-391f74ef668a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:19.578997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8a550-7996-43d8-b20b-391f74ef668a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:19.582819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed5622-a762-4448-b088-bcfdde50f74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:19.583464 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed5622-a762-4448-b088-bcfdde50f74d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.583750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed5622-a762-4448-b088-bcfdde50f74d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.584014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed5622-a762-4448-b088-bcfdde50f74d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-19b8a550-7996-43d8-b20b-391f74ef668a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:19.589402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:19.590633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:14:19.591672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:19.592585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed5622-a762-4448-b088-bcfdde50f74d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:19.592585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed5622-a762-4448-b088-bcfdde50f74d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:19.596424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 423/862] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:14:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:19.596424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8a550-7996-43d8-b20b-391f74ef668a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-53ed5622-a762-4448-b088-bcfdde50f74d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:19.604424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:19.605338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:19.606765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:19.606765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:19.606765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:19.606765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:19.606765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:19.606765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:19.606765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:19.606765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:19.606765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 440/863] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:19.606765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed5622-a762-4448-b088-bcfdde50f74d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:19.666950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:19.711421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed5622-a762-4448-b088-bcfdde50f74d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:19.711664 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:19.714696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8a550-7996-43d8-b20b-391f74ef668a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:19.746576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088bfb7-30ae-4272-b840-53b651788ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:19.747174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088bfb7-30ae-4272-b840-53b651788ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.747475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088bfb7-30ae-4272-b840-53b651788ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.747795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088bfb7-30ae-4272-b840-53b651788ea1 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.748436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088bfb7-30ae-4272-b840-53b651788ea1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:19.748728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088bfb7-30ae-4272-b840-53b651788ea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:19.750151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088bfb7-30ae-4272-b840-53b651788ea1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:19.755321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7259e5-5f99-4db2-b2ce-748a9aa2491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:19.755321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7259e5-5f99-4db2-b2ce-748a9aa2491d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.755321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7259e5-5f99-4db2-b2ce-748a9aa2491d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.755321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7259e5-5f99-4db2-b2ce-748a9aa2491d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.755682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7259e5-5f99-4db2-b2ce-748a9aa2491d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:19.756030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7259e5-5f99-4db2-b2ce-748a9aa2491d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:19.762615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 441/864] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:14:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:19.765743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088bfb7-30ae-4272-b840-53b651788ea1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-5a7259e5-5f99-4db2-b2ce-748a9aa2491d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:19.765880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:19.766880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:19.767776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 424/865] 10.222.0.49 () {56 vars in 1132 bytes} [Fri Sep 16 19:14:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:19.768624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7259e5-5f99-4db2-b2ce-748a9aa2491d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:19.876841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088bfb7-30ae-4272-b840-53b651788ea1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:19.877367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7259e5-5f99-4db2-b2ce-748a9aa2491d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:19.900213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:19.911550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996735-0c1d-4d80-a326-86edf018fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:19.912169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996735-0c1d-4d80-a326-86edf018fb8b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.912476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996735-0c1d-4d80-a326-86edf018fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.912751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996735-0c1d-4d80-a326-86edf018fb8b None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.913446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996735-0c1d-4d80-a326-86edf018fb8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:19.913753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996735-0c1d-4d80-a326-86edf018fb8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:19.915180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89d247-b480-4fe8-aceb-152cd6429511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:19.915300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996735-0c1d-4d80-a326-86edf018fb8b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:19.915789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89d247-b480-4fe8-aceb-152cd6429511 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:19.916062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89d247-b480-4fe8-aceb-152cd6429511 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:19.916327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89d247-b480-4fe8-aceb-152cd6429511 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:19.917195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89d247-b480-4fe8-aceb-152cd6429511 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:19.917440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89d247-b480-4fe8-aceb-152cd6429511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:19.919248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89d247-b480-4fe8-aceb-152cd6429511 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:19.932368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 425/866] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:14:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:19.932368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89d247-b480-4fe8-aceb-152cd6429511 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:19.932691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 442/867] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:19.934742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996735-0c1d-4d80-a326-86edf018fb8b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:19.973858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:20.063969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996735-0c1d-4d80-a326-86edf018fb8b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:20.085403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89d247-b480-4fe8-aceb-152cd6429511 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:20.107391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36d97b-46b9-481f-a5b0-25bdd6913dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:20.108150 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36d97b-46b9-481f-a5b0-25bdd6913dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:20.108500 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36d97b-46b9-481f-a5b0-25bdd6913dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:20.108807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36d97b-46b9-481f-a5b0-25bdd6913dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:20.109666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36d97b-46b9-481f-a5b0-25bdd6913dc0 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=94828db5fc064a539b5b7b17cac1602b) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:20.110098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36d97b-46b9-481f-a5b0-25bdd6913dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:20.111592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36d97b-46b9-481f-a5b0-25bdd6913dc0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:20.124419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 443/868] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:19 2022] GET /identity/v3/role_assignments?user.id=94828db5fc064a539b5b7b17cac1602b&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=71bed99a52684ba990097719b40ef99d => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:20.146728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae3c27-a39a-41d8-b673-59131be6f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:20.147519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3c27-a39a-41d8-b673-59131be6f190 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:20.147909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3c27-a39a-41d8-b673-59131be6f190 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:20.148273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3c27-a39a-41d8-b673-59131be6f190 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:20.150165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae3c27-a39a-41d8-b673-59131be6f190 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:20.150165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae3c27-a39a-41d8-b673-59131be6f190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:20.151009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae3c27-a39a-41d8-b673-59131be6f190 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:20.161268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 426/869] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:20.166665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36d97b-46b9-481f-a5b0-25bdd6913dc0 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:20.221759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:20.283744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36d97b-46b9-481f-a5b0-25bdd6913dc0 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:20.323706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c23ea5-f7f5-4f2a-a683-1741c712812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:20.324674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c23ea5-f7f5-4f2a-a683-1741c712812e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:20.325088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c23ea5-f7f5-4f2a-a683-1741c712812e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:20.325507 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c23ea5-f7f5-4f2a-a683-1741c712812e None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:20.326295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c23ea5-f7f5-4f2a-a683-1741c712812e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:20.326746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c23ea5-f7f5-4f2a-a683-1741c712812e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:20.328299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c23ea5-f7f5-4f2a-a683-1741c712812e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:20.334365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 444/870] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:21.351397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e3e20-5812-4c7f-8a55-2e09d826ae93 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:21.351975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e3e20-5812-4c7f-8a55-2e09d826ae93 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:21.352250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e3e20-5812-4c7f-8a55-2e09d826ae93 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:21.354022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 427/871] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:21.359536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5716700-c248-4a36-8091-330a91748758 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:21.360001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5716700-c248-4a36-8091-330a91748758 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:21.360346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5716700-c248-4a36-8091-330a91748758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:21.379088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f5716700-c248-4a36-8091-330a91748758 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:21.380300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f5716700-c248-4a36-8091-330a91748758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:21.450260 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 445/872] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:21.717039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e3e20-5812-4c7f-8a55-2e09d826ae93 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:21.828487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:21.838875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e3e20-5812-4c7f-8a55-2e09d826ae93 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:21.874373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eb721-7e35-49ad-83b9-81a0e1ab653d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:21.875067 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eb721-7e35-49ad-83b9-81a0e1ab653d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:21.875404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eb721-7e35-49ad-83b9-81a0e1ab653d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:21.875914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eb721-7e35-49ad-83b9-81a0e1ab653d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:21.886733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9eb721-7e35-49ad-83b9-81a0e1ab653d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-9c9eb721-7e35-49ad-83b9-81a0e1ab653d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:21.892193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:21.893178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:21.894037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 428/873] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Sep 16 19:14:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:21.899814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5716700-c248-4a36-8091-330a91748758 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:21.960890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:22.004763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5716700-c248-4a36-8091-330a91748758 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:22.040370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919daaf-8047-4701-93a3-942530721b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:22.041015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919daaf-8047-4701-93a3-942530721b93 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.041345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919daaf-8047-4701-93a3-942530721b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.041622 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919daaf-8047-4701-93a3-942530721b93 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.042354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919daaf-8047-4701-93a3-942530721b93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:22.042659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919daaf-8047-4701-93a3-942530721b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:22.044048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919daaf-8047-4701-93a3-942530721b93 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:22.056354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 446/874] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Sep 16 19:14:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:22.059004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eb721-7e35-49ad-83b9-81a0e1ab653d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:22.171760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eb721-7e35-49ad-83b9-81a0e1ab653d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:22.207909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57ded0-9e47-4118-b367-3e7fe3f5035f None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.208260 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57ded0-9e47-4118-b367-3e7fe3f5035f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.208601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57ded0-9e47-4118-b367-3e7fe3f5035f None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.209065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c78dc8-d8c0-4e0c-aed5-cce5cdcfd4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:22.209752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c78dc8-d8c0-4e0c-aed5-cce5cdcfd4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.210027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c78dc8-d8c0-4e0c-aed5-cce5cdcfd4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.210344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c78dc8-d8c0-4e0c-aed5-cce5cdcfd4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.211426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 447/875] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:22.215546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30053-2b9c-4eb3-b207-e572b9eb0dfe None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.215833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30053-2b9c-4eb3-b207-e572b9eb0dfe None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.216111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30053-2b9c-4eb3-b207-e572b9eb0dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.225820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c78dc8-d8c0-4e0c-aed5-cce5cdcfd4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:22.227337 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c78dc8-d8c0-4e0c-aed5-cce5cdcfd4a2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:22.236801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-b2b30053-2b9c-4eb3-b207-e572b9eb0dfe None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:22.238116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b2b30053-2b9c-4eb3-b207-e572b9eb0dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-17c78dc8-d8c0-4e0c-aed5-cce5cdcfd4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:22.243522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:22.244586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:22.245507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:22.245507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:22.245507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:22.245507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 429/876] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:22.253250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c78dc8-d8c0-4e0c-aed5-cce5cdcfd4a2 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:22.263658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:22.332533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 448/877] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:22.368350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb705e-3c12-4609-bab9-08899bf3c748 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.368993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb705e-3c12-4609-bab9-08899bf3c748 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.368993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb705e-3c12-4609-bab9-08899bf3c748 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.370572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 449/878] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:22.375476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926471da-0314-4024-90fa-866ebe97c068 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.375759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926471da-0314-4024-90fa-866ebe97c068 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.376030 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926471da-0314-4024-90fa-866ebe97c068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.379549 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c78dc8-d8c0-4e0c-aed5-cce5cdcfd4a2 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:22.395763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-926471da-0314-4024-90fa-866ebe97c068 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:22.397100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-926471da-0314-4024-90fa-866ebe97c068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:22.416545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a129cc-b4e2-44d0-b5f4-b558ca080b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:22.417551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a129cc-b4e2-44d0-b5f4-b558ca080b70 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.418047 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a129cc-b4e2-44d0-b5f4-b558ca080b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.418525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a129cc-b4e2-44d0-b5f4-b558ca080b70 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.419408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a129cc-b4e2-44d0-b5f4-b558ca080b70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:22.419815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a129cc-b4e2-44d0-b5f4-b558ca080b70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:22.421335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a129cc-b4e2-44d0-b5f4-b558ca080b70 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:22.425929 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:22.435152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 430/879] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:22.441637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a129cc-b4e2-44d0-b5f4-b558ca080b70 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:22.474850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 450/880] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:22.524864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:22.556922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a129cc-b4e2-44d0-b5f4-b558ca080b70 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:22.591919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f01f85-e7c4-462c-98b9-49d23b5d0c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:22.592585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f01f85-e7c4-462c-98b9-49d23b5d0c0b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.592854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f01f85-e7c4-462c-98b9-49d23b5d0c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.593119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f01f85-e7c4-462c-98b9-49d23b5d0c0b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.599400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926471da-0314-4024-90fa-866ebe97c068 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:22.600642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f01f85-e7c4-462c-98b9-49d23b5d0c0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:22.602376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f01f85-e7c4-462c-98b9-49d23b5d0c0b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-67f01f85-e7c4-462c-98b9-49d23b5d0c0b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:22.618318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:22.619333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:22.620768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 431/881] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Sep 16 19:14:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:22.626944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f01f85-e7c4-462c-98b9-49d23b5d0c0b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:22.711937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926471da-0314-4024-90fa-866ebe97c068 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:22.735801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f01f85-e7c4-462c-98b9-49d23b5d0c0b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:22.747383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9286b3-cee1-4919-9e9b-3823ef2a5f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:22.748032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9286b3-cee1-4919-9e9b-3823ef2a5f38 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.748311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9286b3-cee1-4919-9e9b-3823ef2a5f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.748611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9286b3-cee1-4919-9e9b-3823ef2a5f38 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.749267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9286b3-cee1-4919-9e9b-3823ef2a5f38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:22.750776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9286b3-cee1-4919-9e9b-3823ef2a5f38 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:22.763693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:22.768983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 451/882] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:14:22 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:14:22.770258 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36df069-0c5a-425a-ad2e-1697ee88dc60 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.770538 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36df069-0c5a-425a-ad2e-1697ee88dc60 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.770810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36df069-0c5a-425a-ad2e-1697ee88dc60 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.771989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 452/883] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:22.776675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36df069-0c5a-425a-ad2e-1697ee88dc60 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:22.794589 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60619edb-4ddf-4d22-a802-11425b8df514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:22.795222 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60619edb-4ddf-4d22-a802-11425b8df514 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.795501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60619edb-4ddf-4d22-a802-11425b8df514 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.795772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60619edb-4ddf-4d22-a802-11425b8df514 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.796551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60619edb-4ddf-4d22-a802-11425b8df514 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:22.796861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60619edb-4ddf-4d22-a802-11425b8df514 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:22.798653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60619edb-4ddf-4d22-a802-11425b8df514 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:22.804843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:22.825992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 432/884] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Sep 16 19:14:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:22.825992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57f71-95ad-4bd9-a525-71c655c879a8 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.825992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57f71-95ad-4bd9-a525-71c655c879a8 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.825992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57f71-95ad-4bd9-a525-71c655c879a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.843871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-edc57f71-95ad-4bd9-a525-71c655c879a8 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:22.845295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-edc57f71-95ad-4bd9-a525-71c655c879a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:22.893687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36df069-0c5a-425a-ad2e-1697ee88dc60 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:22.923603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 433/885] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:22.924936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc57f71-95ad-4bd9-a525-71c655c879a8 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:22.940016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67575f-323e-421b-81af-f4558bc3015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:22.941045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67575f-323e-421b-81af-f4558bc3015e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:22.941572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67575f-323e-421b-81af-f4558bc3015e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:22.942126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67575f-323e-421b-81af-f4558bc3015e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:22.943395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67575f-323e-421b-81af-f4558bc3015e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:22.945591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67575f-323e-421b-81af-f4558bc3015e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-4b67575f-323e-421b-81af-f4558bc3015e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:22.955965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:22.957271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:22.958328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:22.960531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 453/886] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:22.967174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67575f-323e-421b-81af-f4558bc3015e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:23.044045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc57f71-95ad-4bd9-a525-71c655c879a8 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:23.056517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:23.069521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:23.089706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67575f-323e-421b-81af-f4558bc3015e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:23.097667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07375017-59d7-4d6f-87a1-9af915713e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:23.098537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07375017-59d7-4d6f-87a1-9af915713e48 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:23.099005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07375017-59d7-4d6f-87a1-9af915713e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:23.099493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07375017-59d7-4d6f-87a1-9af915713e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:23.143534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbe9c7-45fd-4bf3-884d-9fdc2863f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:23.144167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe9c7-45fd-4bf3-884d-9fdc2863f655 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:23.144473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe9c7-45fd-4bf3-884d-9fdc2863f655 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:23.144750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe9c7-45fd-4bf3-884d-9fdc2863f655 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:23.145456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbe9c7-45fd-4bf3-884d-9fdc2863f655 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:23.145802 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbe9c7-45fd-4bf3-884d-9fdc2863f655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:23.147185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbe9c7-45fd-4bf3-884d-9fdc2863f655 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:23.154131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 454/887] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Sep 16 19:14:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:23.159791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbe9c7-45fd-4bf3-884d-9fdc2863f655 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:23.184931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07375017-59d7-4d6f-87a1-9af915713e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:23.186672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07375017-59d7-4d6f-87a1-9af915713e48 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:23.275710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbe9c7-45fd-4bf3-884d-9fdc2863f655 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:23.288414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 434/888] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:22 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:14:23.289276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07375017-59d7-4d6f-87a1-9af915713e48 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:23.301686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:23.316963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309120b-6de1-42c1-9f3b-cbd2c9f3cbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:23.317721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309120b-6de1-42c1-9f3b-cbd2c9f3cbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:23.318767 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309120b-6de1-42c1-9f3b-cbd2c9f3cbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:23.319049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309120b-6de1-42c1-9f3b-cbd2c9f3cbb2 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:23.319694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309120b-6de1-42c1-9f3b-cbd2c9f3cbb2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:23.320045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309120b-6de1-42c1-9f3b-cbd2c9f3cbb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:23.321597 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309120b-6de1-42c1-9f3b-cbd2c9f3cbb2 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:23.336427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 455/889] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Sep 16 19:14:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:23.336427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309120b-6de1-42c1-9f3b-cbd2c9f3cbb2 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:23.352968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:23.423783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07375017-59d7-4d6f-87a1-9af915713e48 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:23.466143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39501ec-7f49-4893-a139-b7c604a76e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:23.467029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39501ec-7f49-4893-a139-b7c604a76e2b None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:23.467471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39501ec-7f49-4893-a139-b7c604a76e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:23.467888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39501ec-7f49-4893-a139-b7c604a76e2b None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:23.468746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39501ec-7f49-4893-a139-b7c604a76e2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:23.470395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39501ec-7f49-4893-a139-b7c604a76e2b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:23.489558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309120b-6de1-42c1-9f3b-cbd2c9f3cbb2 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:23.498042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 435/890] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:14:23 2022] POST /identity/v3/services => generated 269 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:23.546243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1e63c-dc21-4e95-983c-892e4c6ef12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:23.546907 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1e63c-dc21-4e95-983c-892e4c6ef12c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:23.547272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1e63c-dc21-4e95-983c-892e4c6ef12c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:23.547691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1e63c-dc21-4e95-983c-892e4c6ef12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:23.560227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1e63c-dc21-4e95-983c-892e4c6ef12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:23.561740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1e63c-dc21-4e95-983c-892e4c6ef12c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-77e1e63c-dc21-4e95-983c-892e4c6ef12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:23.581868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:23.582869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:23.583783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:23.583783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:23.583783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:23.583783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 456/891] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:23.590325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39501ec-7f49-4893-a139-b7c604a76e2b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:23.670860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:23.709324 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39501ec-7f49-4893-a139-b7c604a76e2b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:23.746712 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b34e06-48f5-4073-b1c8-08680fbe7b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:23.747479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b34e06-48f5-4073-b1c8-08680fbe7b88 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:23.747864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b34e06-48f5-4073-b1c8-08680fbe7b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:23.748217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b34e06-48f5-4073-b1c8-08680fbe7b88 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:23.748992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b34e06-48f5-4073-b1c8-08680fbe7b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:23.749412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b34e06-48f5-4073-b1c8-08680fbe7b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:23.751117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b34e06-48f5-4073-b1c8-08680fbe7b88 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:23.769449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 436/892] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:23.775230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1e63c-dc21-4e95-983c-892e4c6ef12c None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:23.842201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:23.882460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1e63c-dc21-4e95-983c-892e4c6ef12c None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:23.919469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a59f9-62e4-4807-bfd0-9ecd4074e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:23.920106 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a59f9-62e4-4807-bfd0-9ecd4074e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:23.920396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a59f9-62e4-4807-bfd0-9ecd4074e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:23.920693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a59f9-62e4-4807-bfd0-9ecd4074e4b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:23.927736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a59f9-62e4-4807-bfd0-9ecd4074e4b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:23.929240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a59f9-62e4-4807-bfd0-9ecd4074e4b4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-7e5a59f9-62e4-4807-bfd0-9ecd4074e4b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:23.940958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:23.942066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:23.943512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:23.943512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:23.943512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:23.943512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:23.943512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:23.943512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:23.943512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:23.943512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:23.943512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 457/893] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:23.950428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b34e06-48f5-4073-b1c8-08680fbe7b88 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:24.055468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b34e06-48f5-4073-b1c8-08680fbe7b88 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:24.083416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:24.092645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d0d65-674a-4098-9944-8e3921263cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:24.093470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d0d65-674a-4098-9944-8e3921263cfb None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:24.093985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d0d65-674a-4098-9944-8e3921263cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:24.094419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d0d65-674a-4098-9944-8e3921263cfb None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:24.095251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d0d65-674a-4098-9944-8e3921263cfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:24.095695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d0d65-674a-4098-9944-8e3921263cfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:24.097312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d0d65-674a-4098-9944-8e3921263cfb None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:24.111471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 437/894] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:24.117669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a59f9-62e4-4807-bfd0-9ecd4074e4b4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:24.222445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a59f9-62e4-4807-bfd0-9ecd4074e4b4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:24.248742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:24.258027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77151b7c-c072-4ccf-aaad-e54fdc0ac993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:24.258920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77151b7c-c072-4ccf-aaad-e54fdc0ac993 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:24.259494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77151b7c-c072-4ccf-aaad-e54fdc0ac993 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:24.259982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77151b7c-c072-4ccf-aaad-e54fdc0ac993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:24.261092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77151b7c-c072-4ccf-aaad-e54fdc0ac993 None admin] RBAC: Adding query filter params (role.id=aeb8c8c7dec042a5b67f19964036c92a, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=df6eb4ca8ca1446e9bf49ce1ad73989c) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:24.261473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77151b7c-c072-4ccf-aaad-e54fdc0ac993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:24.262987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77151b7c-c072-4ccf-aaad-e54fdc0ac993 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:24.269138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 458/895] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:24 2022] GET /identity/v3/role_assignments?user.id=df6eb4ca8ca1446e9bf49ce1ad73989c&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=aeb8c8c7dec042a5b67f19964036c92a => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:25.082566 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30febdbc-6ded-418d-961e-b2bfee4970ac None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:25.083073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30febdbc-6ded-418d-961e-b2bfee4970ac None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:25.083073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30febdbc-6ded-418d-961e-b2bfee4970ac None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:25.084602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 438/896] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:25.089979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2f09-92b7-45ef-a186-22a1e721753b None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:25.090399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2f09-92b7-45ef-a186-22a1e721753b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:25.090568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2f09-92b7-45ef-a186-22a1e721753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:25.110499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4a1d2f09-92b7-45ef-a186-22a1e721753b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:25.111765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4a1d2f09-92b7-45ef-a186-22a1e721753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:25.183180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 459/897] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:25.458127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30febdbc-6ded-418d-961e-b2bfee4970ac None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:25.565411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30febdbc-6ded-418d-961e-b2bfee4970ac None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:25.610270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84163539-7799-4a6c-82e1-8f6016d5773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:25.611239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163539-7799-4a6c-82e1-8f6016d5773a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:25.611719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163539-7799-4a6c-82e1-8f6016d5773a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:25.612124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163539-7799-4a6c-82e1-8f6016d5773a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:25.613050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84163539-7799-4a6c-82e1-8f6016d5773a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:25.614603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84163539-7799-4a6c-82e1-8f6016d5773a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-84163539-7799-4a6c-82e1-8f6016d5773a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:25.624810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:25.626141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:25.626977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 439/898] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:14:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:25.632356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2f09-92b7-45ef-a186-22a1e721753b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:25.665844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c24d-5b80-4d5e-b5a5-1edfac82cc4d None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:25.666177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c24d-5b80-4d5e-b5a5-1edfac82cc4d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:25.666388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c24d-5b80-4d5e-b5a5-1edfac82cc4d None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:25.668156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 440/899] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:25.677464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b90bb5-ea61-42a7-ae07-2598faf93e27 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:25.677879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b90bb5-ea61-42a7-ae07-2598faf93e27 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:25.678243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b90bb5-ea61-42a7-ae07-2598faf93e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:25.700070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-92b90bb5-ea61-42a7-ae07-2598faf93e27 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:25.702127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-92b90bb5-ea61-42a7-ae07-2598faf93e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:25.760301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:25.761244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2f09-92b7-45ef-a186-22a1e721753b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:25.788565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 441/900] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:25.788749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:25.790347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c388-ec1c-41c1-8ef7-2f11d3203038 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:25.790716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c388-ec1c-41c1-8ef7-2f11d3203038 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:25.791053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c388-ec1c-41c1-8ef7-2f11d3203038 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:25.792539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 442/901] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:25.798059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a3ea0-a64e-4122-a1eb-27d45a1dbb16 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:25.798334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a3ea0-a64e-4122-a1eb-27d45a1dbb16 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:25.798599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a3ea0-a64e-4122-a1eb-27d45a1dbb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:25.818567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ae8a3ea0-a64e-4122-a1eb-27d45a1dbb16 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:25.819797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ae8a3ea0-a64e-4122-a1eb-27d45a1dbb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:25.821145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5a2df-cc70-4cfb-be9a-8dfbf751c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:25.822272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5a2df-cc70-4cfb-be9a-8dfbf751c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:25.823602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5a2df-cc70-4cfb-be9a-8dfbf751c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:25.824089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5a2df-cc70-4cfb-be9a-8dfbf751c5a1 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:25.824975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5a2df-cc70-4cfb-be9a-8dfbf751c5a1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:25.825469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5a2df-cc70-4cfb-be9a-8dfbf751c5a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:25.827625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5a2df-cc70-4cfb-be9a-8dfbf751c5a1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:25.834816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 460/902] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:14:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:25.840772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5a2df-cc70-4cfb-be9a-8dfbf751c5a1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:25.912569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 443/903] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:25.970472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5a2df-cc70-4cfb-be9a-8dfbf751c5a1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:26.005636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6212-d81d-4314-8af3-3dea8752da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:26.006492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6212-d81d-4314-8af3-3dea8752da63 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:26.006940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6212-d81d-4314-8af3-3dea8752da63 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:26.007404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6212-d81d-4314-8af3-3dea8752da63 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:26.008171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6212-d81d-4314-8af3-3dea8752da63 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:26.008648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6212-d81d-4314-8af3-3dea8752da63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:26.010157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6212-d81d-4314-8af3-3dea8752da63 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:26.015917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 461/904] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:14:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:26.025170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a3ea0-a64e-4122-a1eb-27d45a1dbb16 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:26.059240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6212-d81d-4314-8af3-3dea8752da63 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:26.119542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:26.151056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a3ea0-a64e-4122-a1eb-27d45a1dbb16 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:26.170988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:26.194674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6212-d81d-4314-8af3-3dea8752da63 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:26.198572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195770e8-4451-4195-9d1b-0cb56a4b08e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:26.199199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195770e8-4451-4195-9d1b-0cb56a4b08e7 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:26.199477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195770e8-4451-4195-9d1b-0cb56a4b08e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:26.199749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195770e8-4451-4195-9d1b-0cb56a4b08e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:26.200483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195770e8-4451-4195-9d1b-0cb56a4b08e7 None admin] RBAC: Adding query filter params (interface=public, service_id=94c62f3acda541c5803abc7dab8dd248, region_id=RegionOne) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:26.200792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195770e8-4451-4195-9d1b-0cb56a4b08e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:26.202163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195770e8-4451-4195-9d1b-0cb56a4b08e7 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:26.212031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 444/905] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Sep 16 19:14:26 2022] GET /identity/v3/endpoints?service_id=94c62f3acda541c5803abc7dab8dd248&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:26.213068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195770e8-4451-4195-9d1b-0cb56a4b08e7 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:26.235281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212e735-462b-4ca3-9a37-69a41054ea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:26.235902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212e735-462b-4ca3-9a37-69a41054ea80 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:26.236181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212e735-462b-4ca3-9a37-69a41054ea80 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:26.236493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212e735-462b-4ca3-9a37-69a41054ea80 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:26.237166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212e735-462b-4ca3-9a37-69a41054ea80 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:26.238548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212e735-462b-4ca3-9a37-69a41054ea80 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:26.261012 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 462/906] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:14:26 2022] POST /identity/v3/services => generated 241 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:14:26.261517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212e735-462b-4ca3-9a37-69a41054ea80 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:26.337800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195770e8-4451-4195-9d1b-0cb56a4b08e7 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:26.385327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d08c8-4fed-4ca6-a1b7-0d7c38291882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:26.385980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d08c8-4fed-4ca6-a1b7-0d7c38291882 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:26.386256 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d08c8-4fed-4ca6-a1b7-0d7c38291882 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:26.386527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d08c8-4fed-4ca6-a1b7-0d7c38291882 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:26.387143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d08c8-4fed-4ca6-a1b7-0d7c38291882 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:26.388724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d08c8-4fed-4ca6-a1b7-0d7c38291882 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-c15d08c8-4fed-4ca6-a1b7-0d7c38291882 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:26.401761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:26.402790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:26.403721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 445/907] 10.222.0.49 () {56 vars in 1132 bytes} [Fri Sep 16 19:14:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:26.409469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d08c8-4fed-4ca6-a1b7-0d7c38291882 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:26.430389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212e735-462b-4ca3-9a37-69a41054ea80 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:26.433855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:26.462080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:26.479055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bca156-335f-44d6-9072-713114329de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:26.480071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bca156-335f-44d6-9072-713114329de7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:26.480428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bca156-335f-44d6-9072-713114329de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:26.480707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bca156-335f-44d6-9072-713114329de7 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:26.481319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bca156-335f-44d6-9072-713114329de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:26.482696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bca156-335f-44d6-9072-713114329de7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:26.490191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 463/908] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Sep 16 19:14:26 2022] GET /identity/v3/services => generated 1497 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:14:26.502538 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e911472-cbe9-4cd7-a795-a5dfde7b384c None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:26.502828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e911472-cbe9-4cd7-a795-a5dfde7b384c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:26.503097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e911472-cbe9-4cd7-a795-a5dfde7b384c None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:26.504475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 464/909] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:26.511288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a38336-e177-472e-bd15-9737f6ebfad8 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:26.511564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a38336-e177-472e-bd15-9737f6ebfad8 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:26.511830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a38336-e177-472e-bd15-9737f6ebfad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:26.534343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-08a38336-e177-472e-bd15-9737f6ebfad8 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:26.535558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-08a38336-e177-472e-bd15-9737f6ebfad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:26.545176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d08c8-4fed-4ca6-a1b7-0d7c38291882 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:26.590793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15937a4-0598-42d2-b4cd-64c74443bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:26.591349 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15937a4-0598-42d2-b4cd-64c74443bf2f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:26.591660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15937a4-0598-42d2-b4cd-64c74443bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:26.591935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15937a4-0598-42d2-b4cd-64c74443bf2f None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:26.592719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15937a4-0598-42d2-b4cd-64c74443bf2f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:26.593028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15937a4-0598-42d2-b4cd-64c74443bf2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:26.594671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15937a4-0598-42d2-b4cd-64c74443bf2f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:26.601238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 446/910] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:26.609881 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15937a4-0598-42d2-b4cd-64c74443bf2f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:26.620795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 465/911] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:26.716812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:26.720951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15937a4-0598-42d2-b4cd-64c74443bf2f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:26.762364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b04dc-2dc5-41d1-ac0e-a70b68957353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:26.763038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b04dc-2dc5-41d1-ac0e-a70b68957353 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:26.763321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b04dc-2dc5-41d1-ac0e-a70b68957353 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:26.763592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b04dc-2dc5-41d1-ac0e-a70b68957353 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:26.764228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b04dc-2dc5-41d1-ac0e-a70b68957353 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:26.764563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b04dc-2dc5-41d1-ac0e-a70b68957353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:26.765995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b04dc-2dc5-41d1-ac0e-a70b68957353 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:26.776373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 447/912] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:26.780244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a38336-e177-472e-bd15-9737f6ebfad8 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:26.886819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:26.889942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b04dc-2dc5-41d1-ac0e-a70b68957353 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:26.891372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a38336-e177-472e-bd15-9737f6ebfad8 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:26.935955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606153f-8041-4d04-9c05-50ed345a9a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:26.936607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606153f-8041-4d04-9c05-50ed345a9a69 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:26.936885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606153f-8041-4d04-9c05-50ed345a9a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:26.937156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606153f-8041-4d04-9c05-50ed345a9a69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:26.937934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606153f-8041-4d04-9c05-50ed345a9a69 None admin] RBAC: Adding query filter params (interface=public, service_id=51aec10e9d1044eb88264e306ea22f14, region_id=RegionOne) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:26.938791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606153f-8041-4d04-9c05-50ed345a9a69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:26.940658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606153f-8041-4d04-9c05-50ed345a9a69 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:26.949059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 466/913] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Sep 16 19:14:26 2022] GET /identity/v3/endpoints?service_id=51aec10e9d1044eb88264e306ea22f14&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:26.954566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606153f-8041-4d04-9c05-50ed345a9a69 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:27.006699 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b04dc-2dc5-41d1-ac0e-a70b68957353 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:27.042871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29a453-812f-4832-a540-25df086fea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:27.043851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29a453-812f-4832-a540-25df086fea84 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:27.044297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29a453-812f-4832-a540-25df086fea84 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:27.044790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29a453-812f-4832-a540-25df086fea84 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:27.060520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29a453-812f-4832-a540-25df086fea84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-3c29a453-812f-4832-a540-25df086fea84 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:27.065633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:27.066599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:27.067437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:27.068442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 448/914] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Sep 16 19:14:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:27.074938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29a453-812f-4832-a540-25df086fea84 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:27.088922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606153f-8041-4d04-9c05-50ed345a9a69 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:27.102958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:27.137652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0b05d-0933-4834-aace-81baad0ffc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:27.138205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0b05d-0933-4834-aace-81baad0ffc72 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:27.138452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0b05d-0933-4834-aace-81baad0ffc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:27.138743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0b05d-0933-4834-aace-81baad0ffc72 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:27.139606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0b05d-0933-4834-aace-81baad0ffc72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:27.141732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0b05d-0933-4834-aace-81baad0ffc72 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:27.156482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 467/915] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Sep 16 19:14:26 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:14:27.196302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29a453-812f-4832-a540-25df086fea84 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:27.239099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8786c-7739-44f3-98be-37edbdfa180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:27.239729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8786c-7739-44f3-98be-37edbdfa180c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:27.240007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8786c-7739-44f3-98be-37edbdfa180c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:27.240278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8786c-7739-44f3-98be-37edbdfa180c None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:27.241012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8786c-7739-44f3-98be-37edbdfa180c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:27.241316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8786c-7739-44f3-98be-37edbdfa180c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:27.242725 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8786c-7739-44f3-98be-37edbdfa180c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:27.253011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 449/916] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Sep 16 19:14:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:27.258944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0b05d-0933-4834-aace-81baad0ffc72 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:27.295679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:27.385201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0b05d-0933-4834-aace-81baad0ffc72 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:27.423779 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b6d8a-1646-40bc-896e-3214ab7e5638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:27.424820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b6d8a-1646-40bc-896e-3214ab7e5638 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:27.425321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b6d8a-1646-40bc-896e-3214ab7e5638 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:27.425796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b6d8a-1646-40bc-896e-3214ab7e5638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:27.436510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b6d8a-1646-40bc-896e-3214ab7e5638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:27.438854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b6d8a-1646-40bc-896e-3214ab7e5638 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-160b6d8a-1646-40bc-896e-3214ab7e5638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:27.455439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:27.456495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:27.457409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:27.457409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:27.457409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:27.459512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 468/917] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:27.465507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8786c-7739-44f3-98be-37edbdfa180c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:27.559967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:27.575899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8786c-7739-44f3-98be-37edbdfa180c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:27.610433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07462626-9ee3-4b6a-93bc-1b8e6b08190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:27.611048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462626-9ee3-4b6a-93bc-1b8e6b08190a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:27.611325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462626-9ee3-4b6a-93bc-1b8e6b08190a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:27.611604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462626-9ee3-4b6a-93bc-1b8e6b08190a None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:27.612251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07462626-9ee3-4b6a-93bc-1b8e6b08190a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:27.612590 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07462626-9ee3-4b6a-93bc-1b8e6b08190a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:27.613961 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07462626-9ee3-4b6a-93bc-1b8e6b08190a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:27.626534 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 450/918] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:27.632214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b6d8a-1646-40bc-896e-3214ab7e5638 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:27.718004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:27.745942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b6d8a-1646-40bc-896e-3214ab7e5638 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:27.788303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6da82-4c9b-4b5b-8c23-ec7246c9508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:27.788985 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6da82-4c9b-4b5b-8c23-ec7246c9508f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:27.789269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6da82-4c9b-4b5b-8c23-ec7246c9508f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:27.789549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6da82-4c9b-4b5b-8c23-ec7246c9508f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:27.797491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6da82-4c9b-4b5b-8c23-ec7246c9508f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:27.798951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6da82-4c9b-4b5b-8c23-ec7246c9508f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-1ba6da82-4c9b-4b5b-8c23-ec7246c9508f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:27.810395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:27.811413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:27.812482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 469/919] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Sep 16 19:14:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:27.821499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07462626-9ee3-4b6a-93bc-1b8e6b08190a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:27.922632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07462626-9ee3-4b6a-93bc-1b8e6b08190a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:27.969448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4013418-bf2b-4b6b-ae44-0187475363e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:27.970047 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4013418-bf2b-4b6b-ae44-0187475363e9 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:27.970324 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4013418-bf2b-4b6b-ae44-0187475363e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:27.970597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4013418-bf2b-4b6b-ae44-0187475363e9 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:27.971338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4013418-bf2b-4b6b-ae44-0187475363e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:27.971643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4013418-bf2b-4b6b-ae44-0187475363e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:27.973120 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4013418-bf2b-4b6b-ae44-0187475363e9 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:27.992164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 451/920] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Sep 16 19:14:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:27.997652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6da82-4c9b-4b5b-8c23-ec7246c9508f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:28.101775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6da82-4c9b-4b5b-8c23-ec7246c9508f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:28.143218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126dc40-4452-4e02-8011-2e396c185022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:28.143903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126dc40-4452-4e02-8011-2e396c185022 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:28.144135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126dc40-4452-4e02-8011-2e396c185022 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:28.144440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126dc40-4452-4e02-8011-2e396c185022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:28.152106 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:28.156033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126dc40-4452-4e02-8011-2e396c185022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:28.157783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126dc40-4452-4e02-8011-2e396c185022 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-c126dc40-4452-4e02-8011-2e396c185022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:28.172697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:28.173868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:28.174966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:28.174966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:28.174966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:28.176921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 470/921] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:28.182333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4013418-bf2b-4b6b-ae44-0187475363e9 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:28.186658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:28.292008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4013418-bf2b-4b6b-ae44-0187475363e9 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:28.330410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb6b4-f72d-4ac8-ae40-f9c61b21082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:28.331023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb6b4-f72d-4ac8-ae40-f9c61b21082f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:28.331297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb6b4-f72d-4ac8-ae40-f9c61b21082f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:28.331566 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb6b4-f72d-4ac8-ae40-f9c61b21082f None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:28.332220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebb6b4-f72d-4ac8-ae40-f9c61b21082f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:28.332557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebb6b4-f72d-4ac8-ae40-f9c61b21082f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:28.333989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebb6b4-f72d-4ac8-ae40-f9c61b21082f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:28.346924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 452/922] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:28.352551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126dc40-4452-4e02-8011-2e396c185022 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:28.457407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126dc40-4452-4e02-8011-2e396c185022 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:28.492768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7150-cbea-49d9-8b93-9360382c009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:28.493429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7150-cbea-49d9-8b93-9360382c009d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:28.493707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7150-cbea-49d9-8b93-9360382c009d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:28.493978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7150-cbea-49d9-8b93-9360382c009d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:28.502221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7150-cbea-49d9-8b93-9360382c009d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:28.503742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7150-cbea-49d9-8b93-9360382c009d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-72cf7150-cbea-49d9-8b93-9360382c009d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:28.516875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:28.517874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:28.518760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:28.518760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:28.518760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:28.518760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:28.518760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:28.518760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:28.518760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:28.518760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:28.518760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 471/923] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:28.526164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb6b4-f72d-4ac8-ae40-f9c61b21082f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:28.594656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:28.636988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707b23-e57b-46bc-83e2-db27b78324ce None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:28.637642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707b23-e57b-46bc-83e2-db27b78324ce None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:28.638120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707b23-e57b-46bc-83e2-db27b78324ce None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:28.639139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb6b4-f72d-4ac8-ae40-f9c61b21082f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:28.641242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 472/924] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:28.645506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8761b0-3a37-43db-812c-5b4f754372f1 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:28.646033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8761b0-3a37-43db-812c-5b4f754372f1 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:28.646507 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8761b0-3a37-43db-812c-5b4f754372f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:28.664956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-eb8761b0-3a37-43db-812c-5b4f754372f1 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:28.666459 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-eb8761b0-3a37-43db-812c-5b4f754372f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:28.673762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6784e2-51db-4be3-8691-772afb538470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:28.674381 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6784e2-51db-4be3-8691-772afb538470 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:28.674661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6784e2-51db-4be3-8691-772afb538470 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:28.674930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6784e2-51db-4be3-8691-772afb538470 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:28.675721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6784e2-51db-4be3-8691-772afb538470 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:28.676027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6784e2-51db-4be3-8691-772afb538470 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:28.677498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6784e2-51db-4be3-8691-772afb538470 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:28.691145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 453/925] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:28.697283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6784e2-51db-4be3-8691-772afb538470 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:28.724970 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:28.758935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 473/926] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:28.826472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6784e2-51db-4be3-8691-772afb538470 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:28.852031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:28.864634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf822013-3542-4b07-a8ea-e404ab2612a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:28.865306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf822013-3542-4b07-a8ea-e404ab2612a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:28.865582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf822013-3542-4b07-a8ea-e404ab2612a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:28.865853 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf822013-3542-4b07-a8ea-e404ab2612a4 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/df6eb4ca8ca1446e9bf49ce1ad73989c/roles/aeb8c8c7dec042a5b67f19964036c92a` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:28.868007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf822013-3542-4b07-a8ea-e404ab2612a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=df6eb4ca8ca1446e9bf49ce1ad73989c, role_id=aeb8c8c7dec042a5b67f19964036c92a)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:28.869482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf822013-3542-4b07-a8ea-e404ab2612a4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:28.880357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3c1d5-72eb-4dd2-ae1f-6b1a4dbebac2 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:28.880965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3c1d5-72eb-4dd2-ae1f-6b1a4dbebac2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:28.881245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3c1d5-72eb-4dd2-ae1f-6b1a4dbebac2 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:28.882840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 474/927] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:28.886160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 454/928] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:14:28 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/df6eb4ca8ca1446e9bf49ce1ad73989c/roles/aeb8c8c7dec042a5b67f19964036c92a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:14:28.890300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8e05-dafe-45a8-a3b3-7e76da317946 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:28.890614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8e05-dafe-45a8-a3b3-7e76da317946 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:28.891010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8e05-dafe-45a8-a3b3-7e76da317946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:28.911894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-c29f8e05-dafe-45a8-a3b3-7e76da317946 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:28.913185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c29f8e05-dafe-45a8-a3b3-7e76da317946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:28.988904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 475/929] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:29.049987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf822013-3542-4b07-a8ea-e404ab2612a4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:29.158082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf822013-3542-4b07-a8ea-e404ab2612a4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:29.194221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b799cc2-9c51-4c80-952b-98da2cdbac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:29.195146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b799cc2-9c51-4c80-952b-98da2cdbac16 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:29.195571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b799cc2-9c51-4c80-952b-98da2cdbac16 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:29.195988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b799cc2-9c51-4c80-952b-98da2cdbac16 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:29.196779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b799cc2-9c51-4c80-952b-98da2cdbac16 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:29.198292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b799cc2-9c51-4c80-952b-98da2cdbac16 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-0b799cc2-9c51-4c80-952b-98da2cdbac16 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:29.208124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:29.209412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:29.210492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:29.216527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 455/930] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:29.219367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f8e05-dafe-45a8-a3b3-7e76da317946 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:29.266497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b799cc2-9c51-4c80-952b-98da2cdbac16 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:29.322271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:29.327543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f8e05-dafe-45a8-a3b3-7e76da317946 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:29.342856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:29.377718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5fdf-a11b-45a0-8ff4-93c379c54772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:29.378850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5fdf-a11b-45a0-8ff4-93c379c54772 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:29.379728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5fdf-a11b-45a0-8ff4-93c379c54772 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:29.380183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5fdf-a11b-45a0-8ff4-93c379c54772 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:29.381346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5fdf-a11b-45a0-8ff4-93c379c54772 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:29.381805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5fdf-a11b-45a0-8ff4-93c379c54772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:29.384021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5fdf-a11b-45a0-8ff4-93c379c54772 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:29.390807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b799cc2-9c51-4c80-952b-98da2cdbac16 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:29.393076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 476/931] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Sep 16 19:14:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:29.401579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5fdf-a11b-45a0-8ff4-93c379c54772 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:29.431233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1ca8b-0f05-4b96-8342-1c709e33fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:29.432093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ca8b-0f05-4b96-8342-1c709e33fb1a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:29.432559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ca8b-0f05-4b96-8342-1c709e33fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:29.432969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ca8b-0f05-4b96-8342-1c709e33fb1a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:29.433707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1ca8b-0f05-4b96-8342-1c709e33fb1a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:29.435197 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1ca8b-0f05-4b96-8342-1c709e33fb1a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-10c1ca8b-0f05-4b96-8342-1c709e33fb1a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:29.445351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:29.446667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:14:29.447682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:29.450136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 456/932] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:14:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:29.456625 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1ca8b-0f05-4b96-8342-1c709e33fb1a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:29.520076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5fdf-a11b-45a0-8ff4-93c379c54772 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:29.556456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38274d86-347b-4406-a709-90ae9dd451de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:29.557091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38274d86-347b-4406-a709-90ae9dd451de None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:29.557357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38274d86-347b-4406-a709-90ae9dd451de None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:29.557630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38274d86-347b-4406-a709-90ae9dd451de None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:29.558268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38274d86-347b-4406-a709-90ae9dd451de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:29.558568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38274d86-347b-4406-a709-90ae9dd451de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:29.559956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38274d86-347b-4406-a709-90ae9dd451de None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:29.565151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 477/933] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Sep 16 19:14:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:29.566327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0a93-d407-4d17-84ee-7582c0ecc8bc None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:29.566568 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1ca8b-0f05-4b96-8342-1c709e33fb1a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:29.566672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0a93-d407-4d17-84ee-7582c0ecc8bc None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:29.566864 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0a93-d407-4d17-84ee-7582c0ecc8bc None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:29.572564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 478/934] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:29.573325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0a93-d407-4d17-84ee-7582c0ecc8bc None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:29.584047 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:29.608036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4e01b-f571-4a58-8789-cfe4cf9da3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:29.608672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e01b-f571-4a58-8789-cfe4cf9da3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:29.608953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e01b-f571-4a58-8789-cfe4cf9da3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:29.609314 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e01b-f571-4a58-8789-cfe4cf9da3c3 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:29.610062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4e01b-f571-4a58-8789-cfe4cf9da3c3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:29.610366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4e01b-f571-4a58-8789-cfe4cf9da3c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:29.611722 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4e01b-f571-4a58-8789-cfe4cf9da3c3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:29.622336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 457/935] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:14:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:29.622336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d88339-2727-4006-8dc5-5e4cbf77e903 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:29.622336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d88339-2727-4006-8dc5-5e4cbf77e903 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:29.622336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d88339-2727-4006-8dc5-5e4cbf77e903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:29.623381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:29.642823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-91d88339-2727-4006-8dc5-5e4cbf77e903 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:29.644562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-91d88339-2727-4006-8dc5-5e4cbf77e903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:29.686218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0a93-d407-4d17-84ee-7582c0ecc8bc None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:29.726817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5112a8-e0ee-49af-bab7-c653dc3802d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:29.727042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 458/936] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:29.736710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5112a8-e0ee-49af-bab7-c653dc3802d9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:29.736710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5112a8-e0ee-49af-bab7-c653dc3802d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:29.736966 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d88339-2727-4006-8dc5-5e4cbf77e903 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:29.737054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5112a8-e0ee-49af-bab7-c653dc3802d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:29.737054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5112a8-e0ee-49af-bab7-c653dc3802d9 None admin] RBAC: Adding query filter params (interface=public, service_id=2f47aa41c1634b2596206d78572dcdf1, region_id=RegionOne) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:29.737054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5112a8-e0ee-49af-bab7-c653dc3802d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:29.737054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5112a8-e0ee-49af-bab7-c653dc3802d9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:29.737434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 479/937] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Sep 16 19:14:29 2022] GET /identity/v3/endpoints?service_id=2f47aa41c1634b2596206d78572dcdf1&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:29.743292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5112a8-e0ee-49af-bab7-c653dc3802d9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:29.859916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5112a8-e0ee-49af-bab7-c653dc3802d9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:29.862436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:29.868638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d88339-2727-4006-8dc5-5e4cbf77e903 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:29.878705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:29.907086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0215b-9e29-4130-92ff-7630208ebc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:29.908095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0215b-9e29-4130-92ff-7630208ebc7f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:29.908495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0215b-9e29-4130-92ff-7630208ebc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:29.908857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0215b-9e29-4130-92ff-7630208ebc7f None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:29.909559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0215b-9e29-4130-92ff-7630208ebc7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:29.911038 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0215b-9e29-4130-92ff-7630208ebc7f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:29.913260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05467b1-6baa-4936-8106-9f92048d6328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:29.914057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05467b1-6baa-4936-8106-9f92048d6328 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:29.914736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05467b1-6baa-4936-8106-9f92048d6328 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:29.915167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05467b1-6baa-4936-8106-9f92048d6328 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:29.915943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05467b1-6baa-4936-8106-9f92048d6328 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:29.916401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05467b1-6baa-4936-8106-9f92048d6328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:29.917930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05467b1-6baa-4936-8106-9f92048d6328 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:29.918299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 480/938] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Sep 16 19:14:29 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:14:29.929038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 459/939] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Sep 16 19:14:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:29.935498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0215b-9e29-4130-92ff-7630208ebc7f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:30.033541 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05467b1-6baa-4936-8106-9f92048d6328 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:30.055398 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0215b-9e29-4130-92ff-7630208ebc7f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:30.110289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f1a3a-af30-484d-a3e3-081a4471eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:30.111496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1a3a-af30-484d-a3e3-081a4471eb16 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:30.111922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1a3a-af30-484d-a3e3-081a4471eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:30.112852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1a3a-af30-484d-a3e3-081a4471eb16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:30.113727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f1a3a-af30-484d-a3e3-081a4471eb16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:30.115801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f1a3a-af30-484d-a3e3-081a4471eb16 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:30.146210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 481/940] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:14:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:30.168520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05467b1-6baa-4936-8106-9f92048d6328 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:30.219357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cd00d-e63e-44cf-965c-289d91c4ce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:30.220011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cd00d-e63e-44cf-965c-289d91c4ce8f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:30.220287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cd00d-e63e-44cf-965c-289d91c4ce8f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:30.220619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cd00d-e63e-44cf-965c-289d91c4ce8f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:30.221218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cd00d-e63e-44cf-965c-289d91c4ce8f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:30.222866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cd00d-e63e-44cf-965c-289d91c4ce8f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-1a3cd00d-e63e-44cf-965c-289d91c4ce8f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:30.233073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:30.234513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:30.235428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 460/941] 10.222.0.49 () {56 vars in 1132 bytes} [Fri Sep 16 19:14:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:30.240995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f1a3a-af30-484d-a3e3-081a4471eb16 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:30.269923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:30.360881 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f1a3a-af30-484d-a3e3-081a4471eb16 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:30.398787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174f060-2b96-4e1a-89fa-4bd9b4710db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:30.399417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174f060-2b96-4e1a-89fa-4bd9b4710db8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:30.399697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174f060-2b96-4e1a-89fa-4bd9b4710db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:30.399969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174f060-2b96-4e1a-89fa-4bd9b4710db8 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:30.400644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174f060-2b96-4e1a-89fa-4bd9b4710db8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:30.400949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174f060-2b96-4e1a-89fa-4bd9b4710db8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:30.402345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174f060-2b96-4e1a-89fa-4bd9b4710db8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:30.408373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 482/942] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:30.414329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cd00d-e63e-44cf-965c-289d91c4ce8f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:30.450811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:30.527287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cd00d-e63e-44cf-965c-289d91c4ce8f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:30.564667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc5bb7-77b2-4a73-9cd2-71c69d86a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:30.565286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc5bb7-77b2-4a73-9cd2-71c69d86a298 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:30.565563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc5bb7-77b2-4a73-9cd2-71c69d86a298 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:30.565842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc5bb7-77b2-4a73-9cd2-71c69d86a298 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:30.566480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc5bb7-77b2-4a73-9cd2-71c69d86a298 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:30.566785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc5bb7-77b2-4a73-9cd2-71c69d86a298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:30.568604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc5bb7-77b2-4a73-9cd2-71c69d86a298 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:30.574082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 461/943] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:30.579944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174f060-2b96-4e1a-89fa-4bd9b4710db8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:30.670596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:30.687081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174f060-2b96-4e1a-89fa-4bd9b4710db8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:30.724493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d90e6b-91c2-43cf-b709-c806182888d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:30.725469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d90e6b-91c2-43cf-b709-c806182888d3 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:30.725941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d90e6b-91c2-43cf-b709-c806182888d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:30.726407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d90e6b-91c2-43cf-b709-c806182888d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:30.727311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d90e6b-91c2-43cf-b709-c806182888d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:30.728913 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d90e6b-91c2-43cf-b709-c806182888d3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:30.768810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 483/944] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:14:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:31.227639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c3a59-b78c-465c-9708-6e8aecb8f094 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:31.228042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c3a59-b78c-465c-9708-6e8aecb8f094 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:31.228180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c3a59-b78c-465c-9708-6e8aecb8f094 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:31.229866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 462/945] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:31.235552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a5094-afed-4c98-a369-439b431fdbd3 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:31.235842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a5094-afed-4c98-a369-439b431fdbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:31.236121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a5094-afed-4c98-a369-439b431fdbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:31.254988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-006a5094-afed-4c98-a369-439b431fdbd3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:31.256195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-006a5094-afed-4c98-a369-439b431fdbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:31.336499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 484/946] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:31.593116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c3a59-b78c-465c-9708-6e8aecb8f094 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:31.691858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:31.701368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c3a59-b78c-465c-9708-6e8aecb8f094 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:31.741121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5799-4148-4920-b61a-9e1c7451eb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:31.741760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5799-4148-4920-b61a-9e1c7451eb7f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:31.742037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5799-4148-4920-b61a-9e1c7451eb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:31.742309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5799-4148-4920-b61a-9e1c7451eb7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:31.755688 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff5799-4148-4920-b61a-9e1c7451eb7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-44ff5799-4148-4920-b61a-9e1c7451eb7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:31.762629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:31.763648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:31.764507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 463/947] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Sep 16 19:14:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:31.768478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a5094-afed-4c98-a369-439b431fdbd3 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:31.837759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:31.871848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a5094-afed-4c98-a369-439b431fdbd3 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:31.906518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8f009-f0bd-414c-b04a-c78d60891712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:31.907172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8f009-f0bd-414c-b04a-c78d60891712 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:31.907409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8f009-f0bd-414c-b04a-c78d60891712 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:31.907679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8f009-f0bd-414c-b04a-c78d60891712 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:31.908342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8f009-f0bd-414c-b04a-c78d60891712 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:31.908675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8f009-f0bd-414c-b04a-c78d60891712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:31.910058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8f009-f0bd-414c-b04a-c78d60891712 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:31.918724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 485/948] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Sep 16 19:14:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:31.925510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5799-4148-4920-b61a-9e1c7451eb7f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:32.029340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5799-4148-4920-b61a-9e1c7451eb7f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:32.064873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7bef-efcf-4ea1-8efb-6f61535d4f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:32.065895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7bef-efcf-4ea1-8efb-6f61535d4f64 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:32.066375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7bef-efcf-4ea1-8efb-6f61535d4f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:32.066870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7bef-efcf-4ea1-8efb-6f61535d4f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:32.078966 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc7bef-efcf-4ea1-8efb-6f61535d4f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:32.080781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc7bef-efcf-4ea1-8efb-6f61535d4f64 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-05dc7bef-efcf-4ea1-8efb-6f61535d4f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:32.098247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:32.099272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:32.100208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:32.100208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:32.100208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:32.106900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 464/949] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:32.108525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8f009-f0bd-414c-b04a-c78d60891712 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:32.214872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8f009-f0bd-414c-b04a-c78d60891712 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:32.244795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:32.250998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c5667-528e-4d4a-8c5a-87448e751389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:32.251618 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5667-528e-4d4a-8c5a-87448e751389 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:32.251887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5667-528e-4d4a-8c5a-87448e751389 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:32.252160 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5667-528e-4d4a-8c5a-87448e751389 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:32.252831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c5667-528e-4d4a-8c5a-87448e751389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:32.253130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c5667-528e-4d4a-8c5a-87448e751389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:32.254496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c5667-528e-4d4a-8c5a-87448e751389 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:32.267040 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 486/950] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:32.273356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7bef-efcf-4ea1-8efb-6f61535d4f64 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:32.283386 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:32.325098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c78b35-4d7b-4dc6-81e1-7bb052142b55 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:32.325465 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c78b35-4d7b-4dc6-81e1-7bb052142b55 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:32.325643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c78b35-4d7b-4dc6-81e1-7bb052142b55 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:32.327136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 487/951] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:32.333474 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850db98-d11a-4595-843a-c78e0eb8c1fe None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:32.333752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850db98-d11a-4595-843a-c78e0eb8c1fe None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:32.334030 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850db98-d11a-4595-843a-c78e0eb8c1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:32.352900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5850db98-d11a-4595-843a-c78e0eb8c1fe None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:32.354545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5850db98-d11a-4595-843a-c78e0eb8c1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:32.396858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7bef-efcf-4ea1-8efb-6f61535d4f64 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:32.429872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 488/952] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:32.443224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8bb01-2763-488e-81dd-744ac15987b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:32.444172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8bb01-2763-488e-81dd-744ac15987b9 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:32.444704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8bb01-2763-488e-81dd-744ac15987b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:32.445182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8bb01-2763-488e-81dd-744ac15987b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:32.453947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8bb01-2763-488e-81dd-744ac15987b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:32.455714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8bb01-2763-488e-81dd-744ac15987b9 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-dde8bb01-2763-488e-81dd-744ac15987b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:32.467658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:32.469054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:32.470022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:32.470022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:32.470022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:32.470022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:32.470022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:32.470022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:32.470022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:32.470022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:32.470022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:14:32.470022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:32.472528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 465/953] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Sep 16 19:14:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:32.481513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850db98-d11a-4595-843a-c78e0eb8c1fe None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:32.483624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35478f-e3d6-452b-b081-8081f72a25db None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:32.484164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35478f-e3d6-452b-b081-8081f72a25db None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:32.484712 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35478f-e3d6-452b-b081-8081f72a25db None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:32.486575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 466/954] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:32.492075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538030-5b6b-4c47-91b0-573df37a077f None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:32.492620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538030-5b6b-4c47-91b0-573df37a077f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:32.493072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538030-5b6b-4c47-91b0-573df37a077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:32.513052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-0e538030-5b6b-4c47-91b0-573df37a077f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:32.514743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0e538030-5b6b-4c47-91b0-573df37a077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:32.590953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850db98-d11a-4595-843a-c78e0eb8c1fe None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:32.595463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:32.611802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 467/955] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:32.618141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:32.633221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710e0ce-e2e1-4d9c-bd40-7f77de019a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:32.633846 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e0ce-e2e1-4d9c-bd40-7f77de019a0c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:32.634131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e0ce-e2e1-4d9c-bd40-7f77de019a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:32.634407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e0ce-e2e1-4d9c-bd40-7f77de019a0c None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:32.635213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710e0ce-e2e1-4d9c-bd40-7f77de019a0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:32.635526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710e0ce-e2e1-4d9c-bd40-7f77de019a0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:32.637235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710e0ce-e2e1-4d9c-bd40-7f77de019a0c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:32.660512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 489/956] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Sep 16 19:14:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:32.662475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e538030-5b6b-4c47-91b0-573df37a077f None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:32.709726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710e0ce-e2e1-4d9c-bd40-7f77de019a0c None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:32.777349 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e538030-5b6b-4c47-91b0-573df37a077f None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:32.818790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710e0ce-e2e1-4d9c-bd40-7f77de019a0c None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:32.819721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35511e28-92ac-4454-a2f1-27e5b4ee466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:32.820350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35511e28-92ac-4454-a2f1-27e5b4ee466c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:32.820674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35511e28-92ac-4454-a2f1-27e5b4ee466c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:32.820950 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35511e28-92ac-4454-a2f1-27e5b4ee466c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:32.856660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52708768-2765-4c51-bef9-29e2229f41f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:32.857691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52708768-2765-4c51-bef9-29e2229f41f1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:32.858165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52708768-2765-4c51-bef9-29e2229f41f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:32.858630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52708768-2765-4c51-bef9-29e2229f41f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:32.860262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52708768-2765-4c51-bef9-29e2229f41f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:32.861884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52708768-2765-4c51-bef9-29e2229f41f1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-52708768-2765-4c51-bef9-29e2229f41f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:32.871443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:32.872677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:32.873633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:32.881554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 490/957] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:32.881554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52708768-2765-4c51-bef9-29e2229f41f1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:32.892859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:32.901255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35511e28-92ac-4454-a2f1-27e5b4ee466c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:32.902746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35511e28-92ac-4454-a2f1-27e5b4ee466c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:32.934485 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:33.008599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52708768-2765-4c51-bef9-29e2229f41f1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:33.015259 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 468/958] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:14:33.015259 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35511e28-92ac-4454-a2f1-27e5b4ee466c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:33.053367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:33.053892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.054171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.054448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.055093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:33.056611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:33.059237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: WARNING keystone.server.flask.common [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 16 19:14:33.078955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.sql.core [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 19:14:33.078955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 19:14:33.078955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [parameters: {'id': '7f8f2f7a53154df79f1ac69ef3a68ba9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 19:14:33.078955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81441) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f8f2f7a53154df79f1ac69ef3a68ba9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f8f2f7a53154df79f1ac69ef3a68ba9. Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:14:33.085749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result.read() Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 16 19:14:33.086720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application yield resource Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise self.value Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application session.commit() Sep 16 19:14:33.087727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.session.flush() Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application compat.raise_( Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 19:14:33.088667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 19:14:33.089587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result.read() Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:14:33.090470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [parameters: {'id': '7f8f2f7a53154df79f1ac69ef3a68ba9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:33.091350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:33.093193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f8f2f7a53154df79f1ac69ef3a68ba9. Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 491/959] 10.222.0.49 () {60 vars in 1140 bytes} [Fri Sep 16 19:14:32 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:33.095022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:33.115180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:33.122721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35511e28-92ac-4454-a2f1-27e5b4ee466c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:33.156311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95585a-eb0d-481c-b11d-c1a40f7e6583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:33.156939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95585a-eb0d-481c-b11d-c1a40f7e6583 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.157205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95585a-eb0d-481c-b11d-c1a40f7e6583 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.157468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95585a-eb0d-481c-b11d-c1a40f7e6583 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.158094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95585a-eb0d-481c-b11d-c1a40f7e6583 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:33.158389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95585a-eb0d-481c-b11d-c1a40f7e6583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:33.159742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95585a-eb0d-481c-b11d-c1a40f7e6583 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:33.164505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 469/960] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Sep 16 19:14:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:33.165543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba065cc8-8f8a-4945-852e-d72ad1b09d88 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.165819 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba065cc8-8f8a-4945-852e-d72ad1b09d88 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.166083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba065cc8-8f8a-4945-852e-d72ad1b09d88 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.167272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 470/961] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:33.167941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba065cc8-8f8a-4945-852e-d72ad1b09d88 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:33.193868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:33.198077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3a261-a021-4922-b03c-3f4cf5cdce90 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:33.232824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013acb1-de67-48ea-a64c-837e52d632ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:33.233580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013acb1-de67-48ea-a64c-837e52d632ea None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.233946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013acb1-de67-48ea-a64c-837e52d632ea None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.234367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013acb1-de67-48ea-a64c-837e52d632ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.246068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013acb1-de67-48ea-a64c-837e52d632ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:33.247745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013acb1-de67-48ea-a64c-837e52d632ea None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-9013acb1-de67-48ea-a64c-837e52d632ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:33.262602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:33.263745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:33.265112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:33.265112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:33.265112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:33.265112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 492/962] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:33.265112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013acb1-de67-48ea-a64c-837e52d632ea None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:33.271502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba065cc8-8f8a-4945-852e-d72ad1b09d88 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:33.307619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723b8f2-ed7c-448f-b70e-6b513a08498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:33.308181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723b8f2-ed7c-448f-b70e-6b513a08498e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.308491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723b8f2-ed7c-448f-b70e-6b513a08498e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.308769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723b8f2-ed7c-448f-b70e-6b513a08498e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.315576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723b8f2-ed7c-448f-b70e-6b513a08498e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:33.317049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723b8f2-ed7c-448f-b70e-6b513a08498e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-5723b8f2-ed7c-448f-b70e-6b513a08498e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:33.328923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:33.329839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:33.330740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:33.330740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:33.330740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:33.330740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:33.330740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:33.330740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:33.330740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:33.330740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:33.330740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 471/963] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:33.331230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2eebc-25cd-41f2-8048-31628ce338de None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.331483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2eebc-25cd-41f2-8048-31628ce338de None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.331778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2eebc-25cd-41f2-8048-31628ce338de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.349428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-5ab2eebc-25cd-41f2-8048-31628ce338de None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:33.350639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5ab2eebc-25cd-41f2-8048-31628ce338de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:33.365481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:33.372453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013acb1-de67-48ea-a64c-837e52d632ea None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:33.409230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9711-344b-460a-97b5-9977afbf2062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:33.409855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9711-344b-460a-97b5-9977afbf2062 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.410134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9711-344b-460a-97b5-9977afbf2062 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.410409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9711-344b-460a-97b5-9977afbf2062 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.411084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc9711-344b-460a-97b5-9977afbf2062 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:33.411411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc9711-344b-460a-97b5-9977afbf2062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:33.412805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc9711-344b-460a-97b5-9977afbf2062 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:33.420691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 493/964] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Sep 16 19:14:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:33.422214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9711-344b-460a-97b5-9977afbf2062 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:33.429415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 472/965] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:33.430267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2eebc-25cd-41f2-8048-31628ce338de None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:33.438580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:33.543115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2eebc-25cd-41f2-8048-31628ce338de None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:33.543595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9711-344b-460a-97b5-9977afbf2062 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:33.583484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d90c1b-291a-4c67-8692-41f273e291d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:33.583900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea26d46-ddd1-441c-bdac-99abcc0e34ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:33.584017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d90c1b-291a-4c67-8692-41f273e291d7 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.584281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d90c1b-291a-4c67-8692-41f273e291d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.584577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d90c1b-291a-4c67-8692-41f273e291d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.584697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea26d46-ddd1-441c-bdac-99abcc0e34ed None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.584893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea26d46-ddd1-441c-bdac-99abcc0e34ed None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.585168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea26d46-ddd1-441c-bdac-99abcc0e34ed None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.585259 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d90c1b-291a-4c67-8692-41f273e291d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:33.585789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d90c1b-291a-4c67-8692-41f273e291d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:33.585889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea26d46-ddd1-441c-bdac-99abcc0e34ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:33.586108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea26d46-ddd1-441c-bdac-99abcc0e34ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:33.587242 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d90c1b-291a-4c67-8692-41f273e291d7 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:33.587530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea26d46-ddd1-441c-bdac-99abcc0e34ed None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:33.607496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 494/966] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:33.607496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea26d46-ddd1-441c-bdac-99abcc0e34ed None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:33.614837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 473/967] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:33.615928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d90c1b-291a-4c67-8692-41f273e291d7 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:33.646640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:33.721589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:33.755875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea26d46-ddd1-441c-bdac-99abcc0e34ed None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:33.781517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d90c1b-291a-4c67-8692-41f273e291d7 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:33.801628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0d90b-97eb-4ab0-aa6d-5aa2df2769b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:33.802271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d90b-97eb-4ab0-aa6d-5aa2df2769b8 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.802551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d90b-97eb-4ab0-aa6d-5aa2df2769b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.802852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d90b-97eb-4ab0-aa6d-5aa2df2769b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.803556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0d90b-97eb-4ab0-aa6d-5aa2df2769b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:33.805041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0d90b-97eb-4ab0-aa6d-5aa2df2769b8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:33.831986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5e66-91ea-42f9-b6e0-8031c89d9612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:33.832683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5e66-91ea-42f9-b6e0-8031c89d9612 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:33.832952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5e66-91ea-42f9-b6e0-8031c89d9612 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:33.833218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5e66-91ea-42f9-b6e0-8031c89d9612 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:33.840990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 495/968] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:14:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:33.841802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b5e66-91ea-42f9-b6e0-8031c89d9612 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:33.842624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0d90b-97eb-4ab0-aa6d-5aa2df2769b8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:33.843482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b5e66-91ea-42f9-b6e0-8031c89d9612 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-d45b5e66-91ea-42f9-b6e0-8031c89d9612 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:33.859893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:33.860931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:33.862760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:33.862760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:33.862760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:33.862760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:33.862760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:33.862760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:33.862760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:33.862760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:33.862760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 474/969] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:33.874095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5e66-91ea-42f9-b6e0-8031c89d9612 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:34.002542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:34.028328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0d90b-97eb-4ab0-aa6d-5aa2df2769b8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:34.051499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5e66-91ea-42f9-b6e0-8031c89d9612 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:34.063329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:34.079758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d0efd-1d4e-4015-85a5-236378b1d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:34.080921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d0efd-1d4e-4015-85a5-236378b1d14f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:34.081472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d0efd-1d4e-4015-85a5-236378b1d14f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:34.081746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d0efd-1d4e-4015-85a5-236378b1d14f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:34.082347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d0efd-1d4e-4015-85a5-236378b1d14f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:34.084798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d0efd-1d4e-4015-85a5-236378b1d14f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-2b7d0efd-1d4e-4015-85a5-236378b1d14f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:34.095103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:34.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:34.101611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 496/970] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:34.113924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433081-c09b-49eb-ba33-5c039d521f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:34.114941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433081-c09b-49eb-ba33-5c039d521f39 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:34.115122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d0efd-1d4e-4015-85a5-236378b1d14f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:34.115546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433081-c09b-49eb-ba33-5c039d521f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:34.115968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433081-c09b-49eb-ba33-5c039d521f39 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:34.116902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41433081-c09b-49eb-ba33-5c039d521f39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:34.117354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41433081-c09b-49eb-ba33-5c039d521f39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:34.119141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41433081-c09b-49eb-ba33-5c039d521f39 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:34.134205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 475/971] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:34.144407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433081-c09b-49eb-ba33-5c039d521f39 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:34.245746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d0efd-1d4e-4015-85a5-236378b1d14f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:34.264763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433081-c09b-49eb-ba33-5c039d521f39 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:34.296166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1236c-a12d-4174-900a-b24b58309db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:34.296874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1236c-a12d-4174-900a-b24b58309db9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:34.297147 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1236c-a12d-4174-900a-b24b58309db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:34.297404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1236c-a12d-4174-900a-b24b58309db9 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:34.298045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1236c-a12d-4174-900a-b24b58309db9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:34.298343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1236c-a12d-4174-900a-b24b58309db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:34.299742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1236c-a12d-4174-900a-b24b58309db9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:34.303814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:34.306358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 497/972] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:34.311983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71f85c-0754-4a6a-a945-5ec943a73b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:34.313499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1236c-a12d-4174-900a-b24b58309db9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:34.314056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71f85c-0754-4a6a-a945-5ec943a73b7b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:34.314608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71f85c-0754-4a6a-a945-5ec943a73b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:34.315018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71f85c-0754-4a6a-a945-5ec943a73b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:34.315912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71f85c-0754-4a6a-a945-5ec943a73b7b None admin] RBAC: Adding query filter params (role.id=aeb8c8c7dec042a5b67f19964036c92a, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=df6eb4ca8ca1446e9bf49ce1ad73989c) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:34.316366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71f85c-0754-4a6a-a945-5ec943a73b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:34.318356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71f85c-0754-4a6a-a945-5ec943a73b7b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:34.325246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 476/973] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:34 2022] GET /identity/v3/role_assignments?user.id=df6eb4ca8ca1446e9bf49ce1ad73989c&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=aeb8c8c7dec042a5b67f19964036c92a => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:34.399210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:34.466923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1236c-a12d-4174-900a-b24b58309db9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:34.506382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c69ec-fc44-49fc-95b3-d7fff267d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:34.507021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c69ec-fc44-49fc-95b3-d7fff267d48c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:34.507299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c69ec-fc44-49fc-95b3-d7fff267d48c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:34.507578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c69ec-fc44-49fc-95b3-d7fff267d48c None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:34.508224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c69ec-fc44-49fc-95b3-d7fff267d48c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:34.508556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c69ec-fc44-49fc-95b3-d7fff267d48c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:34.509977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c69ec-fc44-49fc-95b3-d7fff267d48c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:34.515943 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 498/974] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:36.067435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d4e99-dac7-401c-8900-56df105bace5 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.068502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d4e99-dac7-401c-8900-56df105bace5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.069022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d4e99-dac7-401c-8900-56df105bace5 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.070841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 477/975] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:36.076354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bca0c7-3490-4231-99f8-e756aaeb42c7 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.077189 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bca0c7-3490-4231-99f8-e756aaeb42c7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.077706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bca0c7-3490-4231-99f8-e756aaeb42c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.096933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-34bca0c7-3490-4231-99f8-e756aaeb42c7 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:36.098819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-34bca0c7-3490-4231-99f8-e756aaeb42c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:36.135748 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f561c1-3e7b-4b97-b09e-eaa01899193b None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.136094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f561c1-3e7b-4b97-b09e-eaa01899193b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.136296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f561c1-3e7b-4b97-b09e-eaa01899193b None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.137950 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 478/976] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:36.143864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbd2e4-7e8d-402e-8038-02e7702beb5c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.144160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbd2e4-7e8d-402e-8038-02e7702beb5c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.144466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbd2e4-7e8d-402e-8038-02e7702beb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.164918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-c7dbd2e4-7e8d-402e-8038-02e7702beb5c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:36.166235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c7dbd2e4-7e8d-402e-8038-02e7702beb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:36.173027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 499/977] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:36.241091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 479/978] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:36.448427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bca0c7-3490-4231-99f8-e756aaeb42c7 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:36.498234 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:36.514530 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbd2e4-7e8d-402e-8038-02e7702beb5c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:36.554081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bca0c7-3490-4231-99f8-e756aaeb42c7 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:36.603066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650d963-dd32-44b1-8aea-54e59595a967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:36.603701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d963-dd32-44b1-8aea-54e59595a967 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.603980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d963-dd32-44b1-8aea-54e59595a967 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.604242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d963-dd32-44b1-8aea-54e59595a967 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.604964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650d963-dd32-44b1-8aea-54e59595a967 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:36.607377 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650d963-dd32-44b1-8aea-54e59595a967 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:36.628371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.sql.core [None req-0650d963-dd32-44b1-8aea-54e59595a967 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 19:14:36.628371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 19:14:36.628371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [parameters: {'user_id': 'b6a4837feb0a4b959f84444eb90e3b64', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 19:14:36.628371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81441) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-0650d963-dd32-44b1-8aea-54e59595a967 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result.read() Sep 16 19:14:36.637830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:14:36.638801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application yield resource Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise self.value Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application session.commit() Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 19:14:36.640556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.session.flush() Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application compat.raise_( Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 19:14:36.641524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:14:36.642458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application result.read() Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:14:36.643293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b6a4837feb0a4b959f84444eb90e3b64', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:36.645694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 16 19:14:36.652856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 16 19:14:36.654126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 16 19:14:36.654126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 16 19:14:36.654126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 19:14:36.654126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 19:14:36.654126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 19:14:36.654126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:36.654531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbd2e4-7e8d-402e-8038-02e7702beb5c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:36.654627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 500/979] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Sep 16 19:14:36 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:36.654627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead0f9b-c054-4137-be48-09d55c7dbf1f None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.654627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead0f9b-c054-4137-be48-09d55c7dbf1f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.654627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead0f9b-c054-4137-be48-09d55c7dbf1f None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.654627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 501/980] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:36.654627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead0f9b-c054-4137-be48-09d55c7dbf1f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:36.673790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:36.686566 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a710ce-cc3e-4945-854f-30a7a8267375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:36.687938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a710ce-cc3e-4945-854f-30a7a8267375 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.688202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a710ce-cc3e-4945-854f-30a7a8267375 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.688508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a710ce-cc3e-4945-854f-30a7a8267375 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.689101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a710ce-cc3e-4945-854f-30a7a8267375 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:36.690474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a710ce-cc3e-4945-854f-30a7a8267375 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-c7a710ce-cc3e-4945-854f-30a7a8267375 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:36.700742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:36.701832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:36.703598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 480/981] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:36.704455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7c11-030c-4e13-8dad-5ec0b5ff3f59 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.704455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7c11-030c-4e13-8dad-5ec0b5ff3f59 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.704455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7c11-030c-4e13-8dad-5ec0b5ff3f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.724825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e99a7c11-030c-4e13-8dad-5ec0b5ff3f59 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:36.725886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e99a7c11-030c-4e13-8dad-5ec0b5ff3f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:36.771070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead0f9b-c054-4137-be48-09d55c7dbf1f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:36.783053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:36.797870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 481/982] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:36.798567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7c11-030c-4e13-8dad-5ec0b5ff3f59 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:36.820048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af4419-b0b2-4be7-adb7-b05187cf2d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:36.821386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af4419-b0b2-4be7-adb7-b05187cf2d3d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.822097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af4419-b0b2-4be7-adb7-b05187cf2d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.822564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af4419-b0b2-4be7-adb7-b05187cf2d3d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.832312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af4419-b0b2-4be7-adb7-b05187cf2d3d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:36.833825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af4419-b0b2-4be7-adb7-b05187cf2d3d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-88af4419-b0b2-4be7-adb7-b05187cf2d3d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:36.848949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:36.849924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:36.850872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 502/983] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:14:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:36.852113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b93628-d565-407c-a236-033b63204478 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.852213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b93628-d565-407c-a236-033b63204478 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.852498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b93628-d565-407c-a236-033b63204478 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.853870 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 503/984] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:36.856630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b93628-d565-407c-a236-033b63204478 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:36.909787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7c11-030c-4e13-8dad-5ec0b5ff3f59 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:36.928290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:36.949296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b2ca0-fb11-496c-b8cc-c0b5244f9782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:36.949911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2ca0-fb11-496c-b8cc-c0b5244f9782 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.950188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2ca0-fb11-496c-b8cc-c0b5244f9782 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.950459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2ca0-fb11-496c-b8cc-c0b5244f9782 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.951145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b2ca0-fb11-496c-b8cc-c0b5244f9782 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:36.951393 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b2ca0-fb11-496c-b8cc-c0b5244f9782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:36.953251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b2ca0-fb11-496c-b8cc-c0b5244f9782 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:36.958147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 482/985] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Sep 16 19:14:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:36.959292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb78b7e-9e6c-4386-9fb0-cba28a463c68 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:36.959573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb78b7e-9e6c-4386-9fb0-cba28a463c68 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:36.959843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb78b7e-9e6c-4386-9fb0-cba28a463c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:36.970855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b93628-d565-407c-a236-033b63204478 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:36.978071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-0fb78b7e-9e6c-4386-9fb0-cba28a463c68 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:36.979251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0fb78b7e-9e6c-4386-9fb0-cba28a463c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:37.010254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234e0d-485e-4585-9c84-453c47741dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:37.011338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234e0d-485e-4585-9c84-453c47741dba None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:37.012064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234e0d-485e-4585-9c84-453c47741dba None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:37.012768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234e0d-485e-4585-9c84-453c47741dba None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:37.013652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234e0d-485e-4585-9c84-453c47741dba None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:37.014161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234e0d-485e-4585-9c84-453c47741dba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:37.015905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234e0d-485e-4585-9c84-453c47741dba None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:37.047908 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 483/986] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:37.048793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb78b7e-9e6c-4386-9fb0-cba28a463c68 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:37.060298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 504/987] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Sep 16 19:14:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:37.062721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234e0d-485e-4585-9c84-453c47741dba None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:37.104871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:37.169738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb78b7e-9e6c-4386-9fb0-cba28a463c68 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:37.184613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:37.200646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234e0d-485e-4585-9c84-453c47741dba None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:37.209926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d2728-0e8c-43ac-aff2-5b3710706521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:37.210871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d2728-0e8c-43ac-aff2-5b3710706521 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:37.211319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d2728-0e8c-43ac-aff2-5b3710706521 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:37.211755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d2728-0e8c-43ac-aff2-5b3710706521 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:37.212639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d2728-0e8c-43ac-aff2-5b3710706521 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:37.213126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d2728-0e8c-43ac-aff2-5b3710706521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:37.214735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d2728-0e8c-43ac-aff2-5b3710706521 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:37.221251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 484/988] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Sep 16 19:14:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:37.232608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d2728-0e8c-43ac-aff2-5b3710706521 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:37.240957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77c3aa-fa39-48bf-b3f4-f757e103b2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:37.241694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77c3aa-fa39-48bf-b3f4-f757e103b2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:37.242039 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77c3aa-fa39-48bf-b3f4-f757e103b2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:37.242756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77c3aa-fa39-48bf-b3f4-f757e103b2b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:37.243135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77c3aa-fa39-48bf-b3f4-f757e103b2b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:37.244646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77c3aa-fa39-48bf-b3f4-f757e103b2b8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-1c77c3aa-fa39-48bf-b3f4-f757e103b2b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:37.255007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:37.256077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:37.256999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 505/989] 10.222.0.49 () {56 vars in 1105 bytes} [Fri Sep 16 19:14:37 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:37.262172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77c3aa-fa39-48bf-b3f4-f757e103b2b8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:37.364432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d2728-0e8c-43ac-aff2-5b3710706521 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:37.376316 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:37.385119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77c3aa-fa39-48bf-b3f4-f757e103b2b8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:37.398785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860a06e-6992-44a9-b984-652836587ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:37.399392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860a06e-6992-44a9-b984-652836587ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:37.399671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860a06e-6992-44a9-b984-652836587ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:37.399948 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860a06e-6992-44a9-b984-652836587ae1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:37.400683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860a06e-6992-44a9-b984-652836587ae1 None admin] RBAC: Adding query filter params (interface=admin, service_id=2f47aa41c1634b2596206d78572dcdf1, region_id=RegionOne) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:37.400992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860a06e-6992-44a9-b984-652836587ae1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:37.402362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860a06e-6992-44a9-b984-652836587ae1 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:37.407395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 485/990] 10.222.0.49 () {56 vars in 1249 bytes} [Fri Sep 16 19:14:37 2022] GET /identity/v3/endpoints?service_id=2f47aa41c1634b2596206d78572dcdf1&interface=admin®ion_id=RegionOne => generated 193 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:37.408155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860a06e-6992-44a9-b984-652836587ae1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:37.418656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c64837-f816-4626-8b3e-173ac6f4cc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:37.419276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c64837-f816-4626-8b3e-173ac6f4cc3e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:37.419556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c64837-f816-4626-8b3e-173ac6f4cc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:37.419831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c64837-f816-4626-8b3e-173ac6f4cc3e None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:37.420498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c64837-f816-4626-8b3e-173ac6f4cc3e None admin] RBAC: Adding query filter params (name=image) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:37.420806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c64837-f816-4626-8b3e-173ac6f4cc3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:37.422393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c64837-f816-4626-8b3e-173ac6f4cc3e None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:37.431756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 506/991] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:37.431756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c64837-f816-4626-8b3e-173ac6f4cc3e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:37.451897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:37.509052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860a06e-6992-44a9-b984-652836587ae1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:37.526825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c64837-f816-4626-8b3e-173ac6f4cc3e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:37.542776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678755a-97df-44fd-a106-69c262828b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:37.543380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678755a-97df-44fd-a106-69c262828b39 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:37.543653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678755a-97df-44fd-a106-69c262828b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:37.543909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678755a-97df-44fd-a106-69c262828b39 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:37.544601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678755a-97df-44fd-a106-69c262828b39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:37.545979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678755a-97df-44fd-a106-69c262828b39 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:37.561347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b49f7-73f3-4320-a5a9-658e50347be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:37.562028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 486/992] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:14:37 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:37.562593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b49f7-73f3-4320-a5a9-658e50347be0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:37.562593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b49f7-73f3-4320-a5a9-658e50347be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:37.562758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b49f7-73f3-4320-a5a9-658e50347be0 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:37.562846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678755a-97df-44fd-a106-69c262828b39 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:37.563334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b49f7-73f3-4320-a5a9-658e50347be0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:37.564745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b49f7-73f3-4320-a5a9-658e50347be0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:37.572455 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 507/993] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Sep 16 19:14:37 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:14:37.682281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:37.696833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678755a-97df-44fd-a106-69c262828b39 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:37.737536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c5294-8eb1-45ba-8543-baca8b30a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:37.738211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c5294-8eb1-45ba-8543-baca8b30a120 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:37.738489 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c5294-8eb1-45ba-8543-baca8b30a120 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:37.738763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c5294-8eb1-45ba-8543-baca8b30a120 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:37.739422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c5294-8eb1-45ba-8543-baca8b30a120 None admin] RBAC: Adding query filter params (type=image) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:37.739729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c5294-8eb1-45ba-8543-baca8b30a120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:37.741202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c5294-8eb1-45ba-8543-baca8b30a120 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:37.746868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 487/994] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:39.756905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7199ba-115d-4637-b209-0395cd61595f None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:39.757492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7199ba-115d-4637-b209-0395cd61595f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:39.757492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7199ba-115d-4637-b209-0395cd61595f None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:39.759135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 508/995] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:39.767680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447bc44-fd37-4328-9023-f76090fbd1e9 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:39.768215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447bc44-fd37-4328-9023-f76090fbd1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:39.768215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447bc44-fd37-4328-9023-f76090fbd1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:39.778195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8a1b1-76e0-4a56-bc4e-644768194c1d None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:39.778537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8a1b1-76e0-4a56-bc4e-644768194c1d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:39.778729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8a1b1-76e0-4a56-bc4e-644768194c1d None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:39.780542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 509/996] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:39.786497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a831cf-cdbb-4d78-854b-5f9c428329d3 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:39.786846 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a831cf-cdbb-4d78-854b-5f9c428329d3 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:39.787046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a831cf-cdbb-4d78-854b-5f9c428329d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:39.788602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6447bc44-fd37-4328-9023-f76090fbd1e9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:39.789841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6447bc44-fd37-4328-9023-f76090fbd1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:39.806110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-15a831cf-cdbb-4d78-854b-5f9c428329d3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:39.807655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-15a831cf-cdbb-4d78-854b-5f9c428329d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:39.824110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:39.863215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 488/997] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:39.881591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 510/998] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:39.886295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078596-2afb-4b54-89ff-ad789e4189f6 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:39.886576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078596-2afb-4b54-89ff-ad789e4189f6 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:39.886846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078596-2afb-4b54-89ff-ad789e4189f6 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:39.888287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 489/999] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:39.893565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d3fb0-26ad-42bd-8c16-e787e91b2ca4 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:39.893849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d3fb0-26ad-42bd-8c16-e787e91b2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:39.894117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d3fb0-26ad-42bd-8c16-e787e91b2ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:39.911995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3d9d3fb0-26ad-42bd-8c16-e787e91b2ca4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:39.913202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3d9d3fb0-26ad-42bd-8c16-e787e91b2ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:39.983025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 511/1000] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:40.128627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078596-2afb-4b54-89ff-ad789e4189f6 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:40.147295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d3fb0-26ad-42bd-8c16-e787e91b2ca4 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:40.233707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:40.242515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:40.246780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078596-2afb-4b54-89ff-ad789e4189f6 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:40.263849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d3fb0-26ad-42bd-8c16-e787e91b2ca4 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:40.283022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33375e-5064-4a70-bfbe-6a7e6333f079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:40.283639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33375e-5064-4a70-bfbe-6a7e6333f079 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:40.283911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33375e-5064-4a70-bfbe-6a7e6333f079 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:40.284176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33375e-5064-4a70-bfbe-6a7e6333f079 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:40.284788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33375e-5064-4a70-bfbe-6a7e6333f079 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:40.286156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33375e-5064-4a70-bfbe-6a7e6333f079 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-8b33375e-5064-4a70-bfbe-6a7e6333f079 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:40.294833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:40.295852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:40.297780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 490/1001] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:40.298882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33375e-5064-4a70-bfbe-6a7e6333f079 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:40.301280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81165e-80ca-4118-a07b-3e415e12c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:40.301931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81165e-80ca-4118-a07b-3e415e12c356 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:40.302208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81165e-80ca-4118-a07b-3e415e12c356 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:40.302465 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81165e-80ca-4118-a07b-3e415e12c356 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:40.303241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81165e-80ca-4118-a07b-3e415e12c356 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:40.305513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81165e-80ca-4118-a07b-3e415e12c356 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-bb81165e-80ca-4118-a07b-3e415e12c356 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:40.316309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:40.317707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:40.318552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 512/1002] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Sep 16 19:14:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:40.319404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81165e-80ca-4118-a07b-3e415e12c356 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:40.418858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33375e-5064-4a70-bfbe-6a7e6333f079 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:40.436821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81165e-80ca-4118-a07b-3e415e12c356 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:40.453696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a77e2-1ad9-447b-af3c-c59fcdf465a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:40.454316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a77e2-1ad9-447b-af3c-c59fcdf465a0 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:40.454595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a77e2-1ad9-447b-af3c-c59fcdf465a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:40.454874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a77e2-1ad9-447b-af3c-c59fcdf465a0 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:40.455527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a77e2-1ad9-447b-af3c-c59fcdf465a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:40.456937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a77e2-1ad9-447b-af3c-c59fcdf465a0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:40.472763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea6a3-be0f-4c5d-b169-dc2713a8a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:40.473395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea6a3-be0f-4c5d-b169-dc2713a8a294 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:40.473669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea6a3-be0f-4c5d-b169-dc2713a8a294 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:40.473937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea6a3-be0f-4c5d-b169-dc2713a8a294 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:40.474454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 491/1003] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:14:40 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:40.474908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ea6a3-be0f-4c5d-b169-dc2713a8a294 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:40.475209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ea6a3-be0f-4c5d-b169-dc2713a8a294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:40.475319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a77e2-1ad9-447b-af3c-c59fcdf465a0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:40.476605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ea6a3-be0f-4c5d-b169-dc2713a8a294 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:40.487079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 513/1004] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:40.488325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea6a3-be0f-4c5d-b169-dc2713a8a294 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:40.500451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:40.501099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:40.605337 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea6a3-be0f-4c5d-b169-dc2713a8a294 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:40.615684 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a77e2-1ad9-447b-af3c-c59fcdf465a0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:40.646057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a75a8a-2a93-4092-95b9-33c74e6459c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:40.646803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a75a8a-2a93-4092-95b9-33c74e6459c0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:40.647150 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a75a8a-2a93-4092-95b9-33c74e6459c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:40.647490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a75a8a-2a93-4092-95b9-33c74e6459c0 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:40.648205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a75a8a-2a93-4092-95b9-33c74e6459c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:40.648551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a75a8a-2a93-4092-95b9-33c74e6459c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:40.649963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a75a8a-2a93-4092-95b9-33c74e6459c0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:40.654662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7eb27-4b4f-47ed-99e3-46dd2ea2e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:40.655328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7eb27-4b4f-47ed-99e3-46dd2ea2e676 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:40.655639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7eb27-4b4f-47ed-99e3-46dd2ea2e676 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:40.655891 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7eb27-4b4f-47ed-99e3-46dd2ea2e676 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:40.656665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7eb27-4b4f-47ed-99e3-46dd2ea2e676 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:40.656964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7eb27-4b4f-47ed-99e3-46dd2ea2e676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:40.658325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7eb27-4b4f-47ed-99e3-46dd2ea2e676 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:40.660905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 514/1005] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:40.661686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a75a8a-2a93-4092-95b9-33c74e6459c0 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:40.668374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 492/1006] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Sep 16 19:14:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:40.669206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7eb27-4b4f-47ed-99e3-46dd2ea2e676 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:40.748668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:40.753565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:40.782462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7eb27-4b4f-47ed-99e3-46dd2ea2e676 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:40.788420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a75a8a-2a93-4092-95b9-33c74e6459c0 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:40.819869 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f6c5d-f615-4b9e-b95e-72609f115da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:40.820521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6c5d-f615-4b9e-b95e-72609f115da4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:40.820799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6c5d-f615-4b9e-b95e-72609f115da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:40.821071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6c5d-f615-4b9e-b95e-72609f115da4 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:40.821738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f6c5d-f615-4b9e-b95e-72609f115da4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:40.822037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f6c5d-f615-4b9e-b95e-72609f115da4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:40.823410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f6c5d-f615-4b9e-b95e-72609f115da4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:40.827592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2bfbe-8730-4b7a-9f4e-1b791daf0a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:40.828423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2bfbe-8730-4b7a-9f4e-1b791daf0a62 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:40.828848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 493/1007] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Sep 16 19:14:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:40.829000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2bfbe-8730-4b7a-9f4e-1b791daf0a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:40.829295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2bfbe-8730-4b7a-9f4e-1b791daf0a62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:40.830013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2bfbe-8730-4b7a-9f4e-1b791daf0a62 None admin] RBAC: Adding query filter params (interface=public, service_id=9c00a72740f546f6ac9be6bfd2625f56, region_id=RegionOne) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:40.830328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2bfbe-8730-4b7a-9f4e-1b791daf0a62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:40.831735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2bfbe-8730-4b7a-9f4e-1b791daf0a62 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:40.834464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f6c5d-f615-4b9e-b95e-72609f115da4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:40.838417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 515/1008] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Sep 16 19:14:40 2022] GET /identity/v3/endpoints?service_id=9c00a72740f546f6ac9be6bfd2625f56&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:40.844897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2bfbe-8730-4b7a-9f4e-1b791daf0a62 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:40.950718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f6c5d-f615-4b9e-b95e-72609f115da4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:40.954378 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2bfbe-8730-4b7a-9f4e-1b791daf0a62 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:40.990774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac122fb-0f84-4295-9653-3bc84d2750a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:40.991700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac122fb-0f84-4295-9653-3bc84d2750a9 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:40.992181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac122fb-0f84-4295-9653-3bc84d2750a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:40.992711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac122fb-0f84-4295-9653-3bc84d2750a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:40.993272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ed93-63a1-430c-a17d-571c311681f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:40.993768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac122fb-0f84-4295-9653-3bc84d2750a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:40.993886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ed93-63a1-430c-a17d-571c311681f8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:40.994157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ed93-63a1-430c-a17d-571c311681f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:40.994434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ed93-63a1-430c-a17d-571c311681f8 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:40.995048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24ed93-63a1-430c-a17d-571c311681f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:40.995984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac122fb-0f84-4295-9653-3bc84d2750a9 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:40.996433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24ed93-63a1-430c-a17d-571c311681f8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:40.998209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:41.004422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 516/1009] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Sep 16 19:14:40 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:14:41.019354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:41.032476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 494/1010] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:14:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:42.666573 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7227-4975-4d22-8785-b78771d73bd1 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:42.667209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7227-4975-4d22-8785-b78771d73bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:42.667209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7227-4975-4d22-8785-b78771d73bd1 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:42.668491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 517/1011] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:42.674204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2561d-5a89-4179-9fcc-fd88ed35e7a2 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:42.674666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2561d-5a89-4179-9fcc-fd88ed35e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:42.674922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2561d-5a89-4179-9fcc-fd88ed35e7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:42.693794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-33a2561d-5a89-4179-9fcc-fd88ed35e7a2 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:42.694976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-33a2561d-5a89-4179-9fcc-fd88ed35e7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:42.778046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 495/1012] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:42 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:43.046614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7227-4975-4d22-8785-b78771d73bd1 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:43.162785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7227-4975-4d22-8785-b78771d73bd1 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:43.167178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c696c-8ccf-4cdc-b77c-b88a762997a3 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.167468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c696c-8ccf-4cdc-b77c-b88a762997a3 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.167740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c696c-8ccf-4cdc-b77c-b88a762997a3 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.169271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 496/1013] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:43.174671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ab1f-46d1-4d60-8e77-accbfd7d793c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.174958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ab1f-46d1-4d60-8e77-accbfd7d793c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.175235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ab1f-46d1-4d60-8e77-accbfd7d793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.193746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-14f0ab1f-46d1-4d60-8e77-accbfd7d793c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:43.194924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-14f0ab1f-46d1-4d60-8e77-accbfd7d793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:43.199878 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253421e-6b4e-4da9-900a-5916771e38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:43.200565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253421e-6b4e-4da9-900a-5916771e38ec None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.200957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253421e-6b4e-4da9-900a-5916771e38ec None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.201220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253421e-6b4e-4da9-900a-5916771e38ec None admin] PATH_INFO: `/v3/services/image` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.201832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253421e-6b4e-4da9-900a-5916771e38ec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:43.203229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253421e-6b4e-4da9-900a-5916771e38ec None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-f253421e-6b4e-4da9-900a-5916771e38ec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:43.212240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:43.213358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:43.214243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 518/1014] 10.222.0.49 () {56 vars in 1105 bytes} [Fri Sep 16 19:14:43 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:43.217196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc492747-9478-47fe-8c61-667fcec2fd00 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.217525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc492747-9478-47fe-8c61-667fcec2fd00 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.217805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc492747-9478-47fe-8c61-667fcec2fd00 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.219130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 519/1015] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:43.223868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc492747-9478-47fe-8c61-667fcec2fd00 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:43.262519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 497/1016] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:43.263910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281c28e-a443-4efe-9845-76edffd0ec8b None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.264183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281c28e-a443-4efe-9845-76edffd0ec8b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.264561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281c28e-a443-4efe-9845-76edffd0ec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.282082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-8281c28e-a443-4efe-9845-76edffd0ec8b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:43.283255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8281c28e-a443-4efe-9845-76edffd0ec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:43.287344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:43.331369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc492747-9478-47fe-8c61-667fcec2fd00 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:43.332635 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:43.355906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 498/1017] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:43.369607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52adbb4-9f5b-4d02-8b62-03df5de61345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:43.370498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52adbb4-9f5b-4d02-8b62-03df5de61345 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.370963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52adbb4-9f5b-4d02-8b62-03df5de61345 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.371404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52adbb4-9f5b-4d02-8b62-03df5de61345 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.372202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52adbb4-9f5b-4d02-8b62-03df5de61345 None admin] RBAC: Adding query filter params (name=image) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:43.372707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52adbb4-9f5b-4d02-8b62-03df5de61345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:43.374312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52adbb4-9f5b-4d02-8b62-03df5de61345 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:43.380275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 520/1018] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:43.386345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281c28e-a443-4efe-9845-76edffd0ec8b None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:43.485173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281c28e-a443-4efe-9845-76edffd0ec8b None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:43.518937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85c92f-5d2d-4332-9a38-9b69245e0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:43.519539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85c92f-5d2d-4332-9a38-9b69245e0bcb None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.519811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85c92f-5d2d-4332-9a38-9b69245e0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.520075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85c92f-5d2d-4332-9a38-9b69245e0bcb None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.520726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85c92f-5d2d-4332-9a38-9b69245e0bcb None admin] RBAC: Adding query filter params (type=image) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:43.521023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85c92f-5d2d-4332-9a38-9b69245e0bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:43.522424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85c92f-5d2d-4332-9a38-9b69245e0bcb None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:43.524683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52adbb4-9f5b-4d02-8b62-03df5de61345 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:43.527442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 499/1019] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:43.533434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85c92f-5d2d-4332-9a38-9b69245e0bcb None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:43.585686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:43.630388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52adbb4-9f5b-4d02-8b62-03df5de61345 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:43.638646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85c92f-5d2d-4332-9a38-9b69245e0bcb None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:43.657097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:43.665343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451ba73-5dda-4e96-8d6b-e4a9fbca78a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:43.665981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451ba73-5dda-4e96-8d6b-e4a9fbca78a9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.666261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451ba73-5dda-4e96-8d6b-e4a9fbca78a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.666523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451ba73-5dda-4e96-8d6b-e4a9fbca78a9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.667111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451ba73-5dda-4e96-8d6b-e4a9fbca78a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:43.668514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451ba73-5dda-4e96-8d6b-e4a9fbca78a9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:43.673699 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c3621-a75a-49a4-82af-c8208cb815a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:43.674303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c3621-a75a-49a4-82af-c8208cb815a4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.674795 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c3621-a75a-49a4-82af-c8208cb815a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.674887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c3621-a75a-49a4-82af-c8208cb815a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.675532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c3621-a75a-49a4-82af-c8208cb815a4 None admin] RBAC: Adding query filter params (interface=public, service_id=ff8dc5b896f84ea982b8b8e92dca2c31, region_id=RegionOne) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:43.675834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c3621-a75a-49a4-82af-c8208cb815a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-2451ba73-5dda-4e96-8d6b-e4a9fbca78a9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:43.677174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:43.680445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:14:43.681545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:43.682314 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c3621-a75a-49a4-82af-c8208cb815a4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:43.682396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 521/1020] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:43.682396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451ba73-5dda-4e96-8d6b-e4a9fbca78a9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:43.692473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 500/1021] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Sep 16 19:14:43 2022] GET /identity/v3/endpoints?service_id=ff8dc5b896f84ea982b8b8e92dca2c31&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:43.692473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c3621-a75a-49a4-82af-c8208cb815a4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:43.779415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451ba73-5dda-4e96-8d6b-e4a9fbca78a9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:43.789907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c3621-a75a-49a4-82af-c8208cb815a4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:43.802810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:43.813612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27c3e2-b1d6-495b-8b58-1a4f9856b246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:43.814248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27c3e2-b1d6-495b-8b58-1a4f9856b246 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.814518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27c3e2-b1d6-495b-8b58-1a4f9856b246 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.814787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27c3e2-b1d6-495b-8b58-1a4f9856b246 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.815902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27c3e2-b1d6-495b-8b58-1a4f9856b246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:43.817766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27c3e2-b1d6-495b-8b58-1a4f9856b246 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:43.819347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 522/1022] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:43.820089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27c3e2-b1d6-495b-8b58-1a4f9856b246 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:43.824826 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb64f36-5f02-4fb3-ae02-b0babbe9fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:43.825435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64f36-5f02-4fb3-ae02-b0babbe9fe9a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.825709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64f36-5f02-4fb3-ae02-b0babbe9fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.825976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64f36-5f02-4fb3-ae02-b0babbe9fe9a None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.826628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb64f36-5f02-4fb3-ae02-b0babbe9fe9a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:43.826960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb64f36-5f02-4fb3-ae02-b0babbe9fe9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:43.828299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb64f36-5f02-4fb3-ae02-b0babbe9fe9a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:43.837815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 501/1023] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:43.837815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb64f36-5f02-4fb3-ae02-b0babbe9fe9a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:43.880200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:43.920442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27c3e2-b1d6-495b-8b58-1a4f9856b246 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:43.932680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb64f36-5f02-4fb3-ae02-b0babbe9fe9a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:43.953192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50911248-c5cf-4f31-8b98-0d23981952ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:43.953793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50911248-c5cf-4f31-8b98-0d23981952ee None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.954066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50911248-c5cf-4f31-8b98-0d23981952ee None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.954331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50911248-c5cf-4f31-8b98-0d23981952ee None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.954922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50911248-c5cf-4f31-8b98-0d23981952ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:43.956289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50911248-c5cf-4f31-8b98-0d23981952ee None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:43.962826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 523/1024] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Sep 16 19:14:43 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:14:43.963581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50911248-c5cf-4f31-8b98-0d23981952ee None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:43.969084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71c23d-8796-4929-8b1b-8db529d32fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:43.969718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71c23d-8796-4929-8b1b-8db529d32fe3 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:43.969993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71c23d-8796-4929-8b1b-8db529d32fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:43.970262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71c23d-8796-4929-8b1b-8db529d32fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:43.970927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71c23d-8796-4929-8b1b-8db529d32fe3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:43.972403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71c23d-8796-4929-8b1b-8db529d32fe3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:44.007119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 502/1025] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:14:43 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:44.103790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50911248-c5cf-4f31-8b98-0d23981952ee None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:44.137631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:44.152412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d51d0-c088-479c-a224-86771b45c5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:44.153082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d51d0-c088-479c-a224-86771b45c5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:44.153355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d51d0-c088-479c-a224-86771b45c5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:44.153740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d51d0-c088-479c-a224-86771b45c5b1 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:44.154393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d51d0-c088-479c-a224-86771b45c5b1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:44.154695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d51d0-c088-479c-a224-86771b45c5b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:44.156146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d51d0-c088-479c-a224-86771b45c5b1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:44.162027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 524/1026] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Sep 16 19:14:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:44.168401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71c23d-8796-4929-8b1b-8db529d32fe3 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:44.202643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:44.278375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71c23d-8796-4929-8b1b-8db529d32fe3 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:44.311003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593f11f-857b-456e-a340-746f191d2839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:44.311818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f11f-857b-456e-a340-746f191d2839 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:44.312236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f11f-857b-456e-a340-746f191d2839 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:44.312542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f11f-857b-456e-a340-746f191d2839 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:44.313206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593f11f-857b-456e-a340-746f191d2839 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:44.314564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593f11f-857b-456e-a340-746f191d2839 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:44.336951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 503/1027] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:14:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:14:46.181667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf6f71-3c2e-4bb7-9201-8e6f792a0f32 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:46.182191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf6f71-3c2e-4bb7-9201-8e6f792a0f32 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:46.182191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf6f71-3c2e-4bb7-9201-8e6f792a0f32 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:46.183694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 525/1028] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:46.189239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d433ff-b266-4b3d-a0de-36816310f9ea None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:46.189680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d433ff-b266-4b3d-a0de-36816310f9ea None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:46.189789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d433ff-b266-4b3d-a0de-36816310f9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:46.209466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f1d433ff-b266-4b3d-a0de-36816310f9ea None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:46.210673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f1d433ff-b266-4b3d-a0de-36816310f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:46.266165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795054-882b-4431-aa41-8db5678cb49a None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:46.266499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795054-882b-4431-aa41-8db5678cb49a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:46.266757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795054-882b-4431-aa41-8db5678cb49a None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:46.268270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 526/1029] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:46.273465 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05a321-97ca-4f1b-8fc8-523ca1f9f54d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:46.273831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05a321-97ca-4f1b-8fc8-523ca1f9f54d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:46.274178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05a321-97ca-4f1b-8fc8-523ca1f9f54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:46.292980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-9e05a321-97ca-4f1b-8fc8-523ca1f9f54d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:46.294173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9e05a321-97ca-4f1b-8fc8-523ca1f9f54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:46.297435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 504/1030] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:46.380966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 527/1031] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:46.574536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d433ff-b266-4b3d-a0de-36816310f9ea None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:46.587292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:46.596830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3c747-8a47-408d-85d1-a986e7047e74 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:46.597091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3c747-8a47-408d-85d1-a986e7047e74 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:46.597646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3c747-8a47-408d-85d1-a986e7047e74 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:46.599579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 528/1032] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:46.604734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77227c3e-a679-4a58-99e5-2319967cee6e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:46.604960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77227c3e-a679-4a58-99e5-2319967cee6e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:46.605231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77227c3e-a679-4a58-99e5-2319967cee6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:46.623284 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-77227c3e-a679-4a58-99e5-2319967cee6e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:46.624919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-77227c3e-a679-4a58-99e5-2319967cee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:46.683898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d433ff-b266-4b3d-a0de-36816310f9ea None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:46.692056 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 529/1033] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:46.692789 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77227c3e-a679-4a58-99e5-2319967cee6e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:46.719717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab84e-9e34-492f-b7b0-f57f88de0494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:46.720344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab84e-9e34-492f-b7b0-f57f88de0494 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:46.720650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab84e-9e34-492f-b7b0-f57f88de0494 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:46.721264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab84e-9e34-492f-b7b0-f57f88de0494 None admin] PATH_INFO: `/v3/services/image` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:46.721471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aab84e-9e34-492f-b7b0-f57f88de0494 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:46.722849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aab84e-9e34-492f-b7b0-f57f88de0494 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-d2aab84e-9e34-492f-b7b0-f57f88de0494 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:46.731507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:46.732484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:46.737691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 505/1034] 10.222.0.49 () {56 vars in 1105 bytes} [Fri Sep 16 19:14:46 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:46.740452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab84e-9e34-492f-b7b0-f57f88de0494 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:46.759403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:46.812578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77227c3e-a679-4a58-99e5-2319967cee6e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:46.821828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:46.848434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab84e-9e34-492f-b7b0-f57f88de0494 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:46.849486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4783a-b108-4644-9490-edb30eb19e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:46.850287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4783a-b108-4644-9490-edb30eb19e85 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:46.850718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4783a-b108-4644-9490-edb30eb19e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:46.850988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4783a-b108-4644-9490-edb30eb19e85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:46.852102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4783a-b108-4644-9490-edb30eb19e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:46.853575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4783a-b108-4644-9490-edb30eb19e85 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:46.855323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 530/1035] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:46.860998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4783a-b108-4644-9490-edb30eb19e85 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:46.884402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d41c8-961d-4933-b4c5-d79a0df74fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:46.885016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d41c8-961d-4933-b4c5-d79a0df74fbe None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:46.885288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d41c8-961d-4933-b4c5-d79a0df74fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:46.885557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d41c8-961d-4933-b4c5-d79a0df74fbe None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:46.886179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d41c8-961d-4933-b4c5-d79a0df74fbe None admin] RBAC: Adding query filter params (name=image) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:46.886479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d41c8-961d-4933-b4c5-d79a0df74fbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:46.887833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d41c8-961d-4933-b4c5-d79a0df74fbe None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:46.892797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 506/1036] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:46.898213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d41c8-961d-4933-b4c5-d79a0df74fbe None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:46.970865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4783a-b108-4644-9490-edb30eb19e85 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:46.986978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:47.003426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d41c8-961d-4933-b4c5-d79a0df74fbe None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.004508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02c07b-bddd-4b55-943b-a2d34b0c1ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.005118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02c07b-bddd-4b55-943b-a2d34b0c1ad1 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.005392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02c07b-bddd-4b55-943b-a2d34b0c1ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.005668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02c07b-bddd-4b55-943b-a2d34b0c1ad1 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.006313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02c07b-bddd-4b55-943b-a2d34b0c1ad1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.007758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02c07b-bddd-4b55-943b-a2d34b0c1ad1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.029294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 531/1037] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:14:46 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:47.030352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02c07b-bddd-4b55-943b-a2d34b0c1ad1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.038737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fdf04-d277-4c43-bc9b-d962515c8ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.040110 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fdf04-d277-4c43-bc9b-d962515c8ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.040406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fdf04-d277-4c43-bc9b-d962515c8ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.040770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fdf04-d277-4c43-bc9b-d962515c8ad0 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.041441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fdf04-d277-4c43-bc9b-d962515c8ad0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:47.042142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fdf04-d277-4c43-bc9b-d962515c8ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.043979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fdf04-d277-4c43-bc9b-d962515c8ad0 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.051206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 507/1038] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:47.057319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fdf04-d277-4c43-bc9b-d962515c8ad0 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.062262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:47.144672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02c07b-bddd-4b55-943b-a2d34b0c1ad1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.180058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fdf04-d277-4c43-bc9b-d962515c8ad0 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.182065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e63f7-92ec-4aa2-bd10-c6f551f487e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.182723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e63f7-92ec-4aa2-bd10-c6f551f487e0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.182999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e63f7-92ec-4aa2-bd10-c6f551f487e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.183264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e63f7-92ec-4aa2-bd10-c6f551f487e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.196541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e63f7-92ec-4aa2-bd10-c6f551f487e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-0a3e63f7-92ec-4aa2-bd10-c6f551f487e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:47.201405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:47.202429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:47.203401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:47.208597 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 532/1039] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Sep 16 19:14:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:47.209724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e63f7-92ec-4aa2-bd10-c6f551f487e0 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.223791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e695b-e028-4ac9-9b8e-bdcfb8cf0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.225161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e695b-e028-4ac9-9b8e-bdcfb8cf0e5f None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.225161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e695b-e028-4ac9-9b8e-bdcfb8cf0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.225161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e695b-e028-4ac9-9b8e-bdcfb8cf0e5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.229886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e695b-e028-4ac9-9b8e-bdcfb8cf0e5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.229886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e695b-e028-4ac9-9b8e-bdcfb8cf0e5f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.248975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:47.251349 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 508/1040] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:14:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:14:47.334845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e63f7-92ec-4aa2-bd10-c6f551f487e0 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.380301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8e648-ebd4-45b5-8649-5fc4ad6f18b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.380953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8e648-ebd4-45b5-8649-5fc4ad6f18b9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.381228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8e648-ebd4-45b5-8649-5fc4ad6f18b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.381495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8e648-ebd4-45b5-8649-5fc4ad6f18b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.382170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8e648-ebd4-45b5-8649-5fc4ad6f18b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:47.382473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8e648-ebd4-45b5-8649-5fc4ad6f18b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.383869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8e648-ebd4-45b5-8649-5fc4ad6f18b9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.400060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 533/1041] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Sep 16 19:14:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:47.401208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e695b-e028-4ac9-9b8e-bdcfb8cf0e5f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.469523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:47.515980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e695b-e028-4ac9-9b8e-bdcfb8cf0e5f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.550499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc583-ca70-4575-a239-d6fb26ce036e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.551133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc583-ca70-4575-a239-d6fb26ce036e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.551406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc583-ca70-4575-a239-d6fb26ce036e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.551671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc583-ca70-4575-a239-d6fb26ce036e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.562478 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fc583-ca70-4575-a239-d6fb26ce036e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.563927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fc583-ca70-4575-a239-d6fb26ce036e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-510fc583-ca70-4575-a239-d6fb26ce036e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:47.578277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:47.579277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:47.580187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:47.580187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:47.580187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:47.580187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 509/1042] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:47.585592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8e648-ebd4-45b5-8649-5fc4ad6f18b9 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.678460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:47.689472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8e648-ebd4-45b5-8649-5fc4ad6f18b9 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.723885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e427f-9b31-4ce9-90b3-aec0e986b8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.724518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e427f-9b31-4ce9-90b3-aec0e986b8ab None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.724803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e427f-9b31-4ce9-90b3-aec0e986b8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.725067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e427f-9b31-4ce9-90b3-aec0e986b8ab None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.725698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e427f-9b31-4ce9-90b3-aec0e986b8ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:47.725994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e427f-9b31-4ce9-90b3-aec0e986b8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.727363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e427f-9b31-4ce9-90b3-aec0e986b8ab None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.738862 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 534/1043] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:47.744407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc583-ca70-4575-a239-d6fb26ce036e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.855535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc583-ca70-4575-a239-d6fb26ce036e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.866861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:47.891444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2dada-6d98-4ccd-b720-c0d6d8fc9946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.892077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2dada-6d98-4ccd-b720-c0d6d8fc9946 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.892351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2dada-6d98-4ccd-b720-c0d6d8fc9946 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.892647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2dada-6d98-4ccd-b720-c0d6d8fc9946 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.900270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2dada-6d98-4ccd-b720-c0d6d8fc9946 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.901735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2dada-6d98-4ccd-b720-c0d6d8fc9946 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-87c2dada-6d98-4ccd-b720-c0d6d8fc9946 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:47.912949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:47.913905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:47.914879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:47.914879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:47.914879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:47.914879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:47.914879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:47.914879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:47.914879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:47.914879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:47.914879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:47.914879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:47.917201 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 510/1044] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Sep 16 19:14:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:47.919952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e427f-9b31-4ce9-90b3-aec0e986b8ab None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:48.030625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e427f-9b31-4ce9-90b3-aec0e986b8ab None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:48.067053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b86c2-37d0-4bc0-a1ef-00c240f5f154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:48.067665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b86c2-37d0-4bc0-a1ef-00c240f5f154 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.067937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b86c2-37d0-4bc0-a1ef-00c240f5f154 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.068201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b86c2-37d0-4bc0-a1ef-00c240f5f154 None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.068997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b86c2-37d0-4bc0-a1ef-00c240f5f154 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:48.069298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b86c2-37d0-4bc0-a1ef-00c240f5f154 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:48.070726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b86c2-37d0-4bc0-a1ef-00c240f5f154 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:48.093184 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 535/1045] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Sep 16 19:14:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:48.094437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2dada-6d98-4ccd-b720-c0d6d8fc9946 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:48.199655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2dada-6d98-4ccd-b720-c0d6d8fc9946 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:48.234693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212f8b-d392-4c45-9205-a3f197c6a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:48.235356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212f8b-d392-4c45-9205-a3f197c6a538 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.235650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212f8b-d392-4c45-9205-a3f197c6a538 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.235819 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212f8b-d392-4c45-9205-a3f197c6a538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.275139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:48.304713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f212f8b-d392-4c45-9205-a3f197c6a538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:48.306080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f212f8b-d392-4c45-9205-a3f197c6a538 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:48.409601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 511/1046] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:14:48.411235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b86c2-37d0-4bc0-a1ef-00c240f5f154 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:48.422658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:48.513736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b86c2-37d0-4bc0-a1ef-00c240f5f154 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:48.547371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4ccda-a44e-4572-b96a-7812e245cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:48.548004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4ccda-a44e-4572-b96a-7812e245cd9c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.548275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4ccda-a44e-4572-b96a-7812e245cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.548569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4ccda-a44e-4572-b96a-7812e245cd9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.558989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4ccda-a44e-4572-b96a-7812e245cd9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:48.560368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4ccda-a44e-4572-b96a-7812e245cd9c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-00e4ccda-a44e-4572-b96a-7812e245cd9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:48.575308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:48.576302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:48.581841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:48.581841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:48.581841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:48.581841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 536/1047] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:48.584163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212f8b-d392-4c45-9205-a3f197c6a538 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:48.659268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:48.692683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212f8b-d392-4c45-9205-a3f197c6a538 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:48.727247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931498ab-d6f2-4554-b8ee-e302913dcd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:48.727998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931498ab-d6f2-4554-b8ee-e302913dcd20 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.728405 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931498ab-d6f2-4554-b8ee-e302913dcd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.728781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931498ab-d6f2-4554-b8ee-e302913dcd20 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.729523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931498ab-d6f2-4554-b8ee-e302913dcd20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:48.729928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931498ab-d6f2-4554-b8ee-e302913dcd20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:48.731382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931498ab-d6f2-4554-b8ee-e302913dcd20 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:48.742988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 512/1048] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:48.748625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4ccda-a44e-4572-b96a-7812e245cd9c None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:48.811909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:48.855293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4ccda-a44e-4572-b96a-7812e245cd9c None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:48.889859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525a08-dd16-4dc1-a738-5c32b5e0b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:48.890707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525a08-dd16-4dc1-a738-5c32b5e0b09c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.891110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525a08-dd16-4dc1-a738-5c32b5e0b09c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.891424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525a08-dd16-4dc1-a738-5c32b5e0b09c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.898260 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d525a08-dd16-4dc1-a738-5c32b5e0b09c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:48.899729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d525a08-dd16-4dc1-a738-5c32b5e0b09c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-2d525a08-dd16-4dc1-a738-5c32b5e0b09c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:48.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:48.912323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:48.913267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:48.913267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:48.913267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:48.913267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:48.913267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:48.913267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:48.913267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:48.913267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:48.917511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 537/1049] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:48.918615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931498ab-d6f2-4554-b8ee-e302913dcd20 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:49.019873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931498ab-d6f2-4554-b8ee-e302913dcd20 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:49.048234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:49.055534 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93eab2-e0ae-45bd-a8a0-3c90b1b1cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:49.056136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93eab2-e0ae-45bd-a8a0-3c90b1b1cc24 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.056474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93eab2-e0ae-45bd-a8a0-3c90b1b1cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.056736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93eab2-e0ae-45bd-a8a0-3c90b1b1cc24 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.057431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93eab2-e0ae-45bd-a8a0-3c90b1b1cc24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:49.057739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93eab2-e0ae-45bd-a8a0-3c90b1b1cc24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:49.059228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93eab2-e0ae-45bd-a8a0-3c90b1b1cc24 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:49.072563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 513/1050] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:49.078634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525a08-dd16-4dc1-a738-5c32b5e0b09c None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:49.188886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525a08-dd16-4dc1-a738-5c32b5e0b09c None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:49.210445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:49.226067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928b7ab-518f-453c-98d2-be2d62ee6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:49.226765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928b7ab-518f-453c-98d2-be2d62ee6c8f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.227111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928b7ab-518f-453c-98d2-be2d62ee6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.227449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928b7ab-518f-453c-98d2-be2d62ee6c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.228249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928b7ab-518f-453c-98d2-be2d62ee6c8f None admin] RBAC: Adding query filter params (role.id=aeb8c8c7dec042a5b67f19964036c92a, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=f9988b9fef5c4d559b1918ffe040aaa8) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:49.228653 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928b7ab-518f-453c-98d2-be2d62ee6c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:49.230158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928b7ab-518f-453c-98d2-be2d62ee6c8f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:49.236195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 538/1051] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:49 2022] GET /identity/v3/role_assignments?user.id=f9988b9fef5c4d559b1918ffe040aaa8&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=aeb8c8c7dec042a5b67f19964036c92a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:49.274071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0877e54-28b9-4476-8cda-b44795ea1527 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.274648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0877e54-28b9-4476-8cda-b44795ea1527 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.274648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0877e54-28b9-4476-8cda-b44795ea1527 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.276172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 514/1052] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:49.282081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efb0e7-58d5-4b13-b452-21f8992f655d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.282417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efb0e7-58d5-4b13-b452-21f8992f655d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.282636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efb0e7-58d5-4b13-b452-21f8992f655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.303526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-62efb0e7-58d5-4b13-b452-21f8992f655d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:49.304906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-62efb0e7-58d5-4b13-b452-21f8992f655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:49.382621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 539/1053] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:49.518116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d92f5-65a5-4c4e-8118-51c621e81b8d None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.518368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d92f5-65a5-4c4e-8118-51c621e81b8d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.518630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d92f5-65a5-4c4e-8118-51c621e81b8d None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.519990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 515/1054] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:49.525683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b770d-ae87-4e9a-acdf-d64e9d99af4f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.526142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b770d-ae87-4e9a-acdf-d64e9d99af4f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.526242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b770d-ae87-4e9a-acdf-d64e9d99af4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.545750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-2f5b770d-ae87-4e9a-acdf-d64e9d99af4f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:49.546959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2f5b770d-ae87-4e9a-acdf-d64e9d99af4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:49.620954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 540/1055] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:49.652688 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d92f5-65a5-4c4e-8118-51c621e81b8d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:49.762769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d92f5-65a5-4c4e-8118-51c621e81b8d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:49.806317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215780e2-aa7b-4c7b-9da8-7811c46a103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:49.807445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215780e2-aa7b-4c7b-9da8-7811c46a103d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.807913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215780e2-aa7b-4c7b-9da8-7811c46a103d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.808499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215780e2-aa7b-4c7b-9da8-7811c46a103d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.821150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215780e2-aa7b-4c7b-9da8-7811c46a103d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-215780e2-aa7b-4c7b-9da8-7811c46a103d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:49.826512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:49.827956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:49.828939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:49.832522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 516/1056] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:49.835690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b770d-ae87-4e9a-acdf-d64e9d99af4f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:49.883198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:49.884563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215780e2-aa7b-4c7b-9da8-7811c46a103d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:49.945816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:49.948107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b770d-ae87-4e9a-acdf-d64e9d99af4f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:49.985035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94ac40-9939-4c48-a988-137f321c57d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:49.986062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94ac40-9939-4c48-a988-137f321c57d0 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.986551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94ac40-9939-4c48-a988-137f321c57d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.986974 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94ac40-9939-4c48-a988-137f321c57d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.987822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94ac40-9939-4c48-a988-137f321c57d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:49.988135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94ac40-9939-4c48-a988-137f321c57d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:49.989568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94ac40-9939-4c48-a988-137f321c57d0 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:50.003433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 541/1057] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:14:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:50.004779 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94ac40-9939-4c48-a988-137f321c57d0 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:50.004902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215780e2-aa7b-4c7b-9da8-7811c46a103d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:50.040229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fc0cf-602b-4084-b1c8-ee7d496876b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:50.040881 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc0cf-602b-4084-b1c8-ee7d496876b9 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:50.041161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc0cf-602b-4084-b1c8-ee7d496876b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:50.041607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc0cf-602b-4084-b1c8-ee7d496876b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:50.115887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fc0cf-602b-4084-b1c8-ee7d496876b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:50.117377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fc0cf-602b-4084-b1c8-ee7d496876b9 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:50.118244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94ac40-9939-4c48-a988-137f321c57d0 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:50.127013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:50.160800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0909a1-a277-41fe-9b4e-2c8b54bd9ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:50.161437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0909a1-a277-41fe-9b4e-2c8b54bd9ffe None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:50.161991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0909a1-a277-41fe-9b4e-2c8b54bd9ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:50.162284 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0909a1-a277-41fe-9b4e-2c8b54bd9ffe None admin] PATH_INFO: `/v3/users/e8e0fa6be349400bb93cf06d8e9d4dd9` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:50.168597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:50.179483 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0909a1-a277-41fe-9b4e-2c8b54bd9ffe None admin] RBAC: Authorizing `identity:get_user(user_id=e8e0fa6be349400bb93cf06d8e9d4dd9)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:50.180981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0909a1-a277-41fe-9b4e-2c8b54bd9ffe None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:50.182648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 542/1058] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:14:50 2022] GET /identity/v3/users/e8e0fa6be349400bb93cf06d8e9d4dd9 => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:50.188792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0909a1-a277-41fe-9b4e-2c8b54bd9ffe None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:50.240498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 517/1059] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:14:50.245900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fc0cf-602b-4084-b1c8-ee7d496876b9 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:50.296586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0909a1-a277-41fe-9b4e-2c8b54bd9ffe None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:50.334159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c802e5a-8c07-41d7-9932-973809f05b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:50.334768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c802e5a-8c07-41d7-9932-973809f05b0f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:50.335048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c802e5a-8c07-41d7-9932-973809f05b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:50.335310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c802e5a-8c07-41d7-9932-973809f05b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:50.353801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fc0cf-602b-4084-b1c8-ee7d496876b9 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:50.367468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:50.391861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df275-4364-491f-bb95-fa0320af7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:50.392538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df275-4364-491f-bb95-fa0320af7051 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:50.392790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df275-4364-491f-bb95-fa0320af7051 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:50.393097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df275-4364-491f-bb95-fa0320af7051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:50.404184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59df275-4364-491f-bb95-fa0320af7051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:50.405749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59df275-4364-491f-bb95-fa0320af7051 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:50.412476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c802e5a-8c07-41d7-9932-973809f05b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:50.413948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c802e5a-8c07-41d7-9932-973809f05b0f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-f59df275-4364-491f-bb95-fa0320af7051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:50.422938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:50.423959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:50.424913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:50.424913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:50.424913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:50.424913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 518/1060] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:50.430337 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df275-4364-491f-bb95-fa0320af7051 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:50.433255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:50.526033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 543/1061] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:14:50.527088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c802e5a-8c07-41d7-9932-973809f05b0f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:50.564689 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df275-4364-491f-bb95-fa0320af7051 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:50.589539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:50.601576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c1a25-91f0-4b2c-aa9b-d7d726942008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:50.602189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c1a25-91f0-4b2c-aa9b-d7d726942008 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:50.602463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c1a25-91f0-4b2c-aa9b-d7d726942008 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:50.602733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c1a25-91f0-4b2c-aa9b-d7d726942008 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:50.603371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c1a25-91f0-4b2c-aa9b-d7d726942008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:50.603668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c1a25-91f0-4b2c-aa9b-d7d726942008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:50.605057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c1a25-91f0-4b2c-aa9b-d7d726942008 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:50.617252 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 519/1062] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:50.629919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c802e5a-8c07-41d7-9932-973809f05b0f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:50.667852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab7133-80c2-43a2-b832-80fa356bfc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:50.668616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7133-80c2-43a2-b832-80fa356bfc36 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:50.668900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7133-80c2-43a2-b832-80fa356bfc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:50.669173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7133-80c2-43a2-b832-80fa356bfc36 None admin] PATH_INFO: `/v3/projects/d1f7d380a12d4408a29afc14935da681` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:50.670739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab7133-80c2-43a2-b832-80fa356bfc36 None admin] RBAC: Authorizing `identity:get_project(project_id=d1f7d380a12d4408a29afc14935da681)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:50.672279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab7133-80c2-43a2-b832-80fa356bfc36 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:50.674303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 544/1063] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:14:50 2022] GET /identity/v3/projects/d1f7d380a12d4408a29afc14935da681 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:50.680876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c1a25-91f0-4b2c-aa9b-d7d726942008 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:50.749922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:50.806488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c1a25-91f0-4b2c-aa9b-d7d726942008 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:50.845795 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00574f-4a3a-4179-ae93-f6e22f799071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:50.846413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00574f-4a3a-4179-ae93-f6e22f799071 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:50.846692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00574f-4a3a-4179-ae93-f6e22f799071 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:50.846962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00574f-4a3a-4179-ae93-f6e22f799071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:50.847686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00574f-4a3a-4179-ae93-f6e22f799071 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=d1f7d380a12d4408a29afc14935da681, user.id=e8e0fa6be349400bb93cf06d8e9d4dd9) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:50.847992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00574f-4a3a-4179-ae93-f6e22f799071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:50.849467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00574f-4a3a-4179-ae93-f6e22f799071 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:50.855299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 520/1064] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:50 2022] GET /identity/v3/role_assignments?user.id=e8e0fa6be349400bb93cf06d8e9d4dd9&scope.project.id=d1f7d380a12d4408a29afc14935da681&role.id=71bed99a52684ba990097719b40ef99d => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:51.370821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9a032-7d34-4c6f-b009-c8d9cba00ae0 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:51.371098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9a032-7d34-4c6f-b009-c8d9cba00ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:51.371370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9a032-7d34-4c6f-b009-c8d9cba00ae0 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:51.372775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 545/1065] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:51.378227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9a55-220e-4774-9e43-bf0b73f1e97d None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:51.378695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9a55-220e-4774-9e43-bf0b73f1e97d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:51.378803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9a55-220e-4774-9e43-bf0b73f1e97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:51.397601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-a0ec9a55-220e-4774-9e43-bf0b73f1e97d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:51.398784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a0ec9a55-220e-4774-9e43-bf0b73f1e97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:51.468288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 521/1066] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:51.730320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9a032-7d34-4c6f-b009-c8d9cba00ae0 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:51.839540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9a032-7d34-4c6f-b009-c8d9cba00ae0 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:51.869746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:51.876071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29591987-8960-4386-8ba8-8945a778c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:51.876752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29591987-8960-4386-8ba8-8945a778c689 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:51.877032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29591987-8960-4386-8ba8-8945a778c689 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:51.877300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29591987-8960-4386-8ba8-8945a778c689 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:51.888153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29591987-8960-4386-8ba8-8945a778c689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-29591987-8960-4386-8ba8-8945a778c689 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:51.893062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:51.894061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:51.894922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 546/1067] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Sep 16 19:14:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:51.900580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec9a55-220e-4774-9e43-bf0b73f1e97d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:51.957927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:52.003174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec9a55-220e-4774-9e43-bf0b73f1e97d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:52.040677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f1022-7aec-4277-acd8-0734b8645798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:52.041297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1022-7aec-4277-acd8-0734b8645798 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:52.041578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1022-7aec-4277-acd8-0734b8645798 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:52.041873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1022-7aec-4277-acd8-0734b8645798 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:52.042543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f1022-7aec-4277-acd8-0734b8645798 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:52.042840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f1022-7aec-4277-acd8-0734b8645798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:52.044220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f1022-7aec-4277-acd8-0734b8645798 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:52.052529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 522/1068] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Sep 16 19:14:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:52.058300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29591987-8960-4386-8ba8-8945a778c689 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:52.161893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29591987-8960-4386-8ba8-8945a778c689 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:52.196804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d452a-8a91-4e18-bbf6-698e2bf44b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:52.197419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d452a-8a91-4e18-bbf6-698e2bf44b76 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:52.197691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d452a-8a91-4e18-bbf6-698e2bf44b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:52.197935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d452a-8a91-4e18-bbf6-698e2bf44b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:52.207974 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d452a-8a91-4e18-bbf6-698e2bf44b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:52.209442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d452a-8a91-4e18-bbf6-698e2bf44b76 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-800d452a-8a91-4e18-bbf6-698e2bf44b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:52.223725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:52.224728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:52.225631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:52.225631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:52.225631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:52.225631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 547/1069] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:52.230824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f1022-7aec-4277-acd8-0734b8645798 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:52.341268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f1022-7aec-4277-acd8-0734b8645798 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:52.358523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:52.377599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9dc1a-1787-4b3f-9e2f-96dd5335129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:52.378208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9dc1a-1787-4b3f-9e2f-96dd5335129f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:52.378479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9dc1a-1787-4b3f-9e2f-96dd5335129f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:52.379018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9dc1a-1787-4b3f-9e2f-96dd5335129f None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:52.379374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9dc1a-1787-4b3f-9e2f-96dd5335129f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:52.379670 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9dc1a-1787-4b3f-9e2f-96dd5335129f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:52.381063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9dc1a-1787-4b3f-9e2f-96dd5335129f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:52.393533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 523/1070] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:52.399430 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d452a-8a91-4e18-bbf6-698e2bf44b76 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:52.445743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:52.501306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d452a-8a91-4e18-bbf6-698e2bf44b76 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:52.535904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f737-9dcd-43a5-80d6-ac51f032e5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:52.536549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f737-9dcd-43a5-80d6-ac51f032e5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:52.536821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f737-9dcd-43a5-80d6-ac51f032e5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:52.537088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f737-9dcd-43a5-80d6-ac51f032e5d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:52.544614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79f737-9dcd-43a5-80d6-ac51f032e5d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:52.546209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79f737-9dcd-43a5-80d6-ac51f032e5d4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-fc79f737-9dcd-43a5-80d6-ac51f032e5d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:52.557145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:52.558126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:52.559072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 548/1071] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Sep 16 19:14:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:52.564371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9dc1a-1787-4b3f-9e2f-96dd5335129f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:52.671831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9dc1a-1787-4b3f-9e2f-96dd5335129f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:52.708835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ec598-894a-49b6-9e8a-06dddb26bde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:52.709436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec598-894a-49b6-9e8a-06dddb26bde4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:52.709696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec598-894a-49b6-9e8a-06dddb26bde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:52.710024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec598-894a-49b6-9e8a-06dddb26bde4 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:52.710696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec598-894a-49b6-9e8a-06dddb26bde4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:52.710994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec598-894a-49b6-9e8a-06dddb26bde4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:52.712452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec598-894a-49b6-9e8a-06dddb26bde4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:52.730410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 524/1072] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Sep 16 19:14:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:52.736451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f737-9dcd-43a5-80d6-ac51f032e5d4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:52.843210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f737-9dcd-43a5-80d6-ac51f032e5d4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:52.845562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:52.881172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcca520-4791-4a5c-91bb-165322a699b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:52.881839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcca520-4791-4a5c-91bb-165322a699b7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:52.882118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcca520-4791-4a5c-91bb-165322a699b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:52.882399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcca520-4791-4a5c-91bb-165322a699b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:52.894883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcca520-4791-4a5c-91bb-165322a699b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:52.896426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcca520-4791-4a5c-91bb-165322a699b7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-7fcca520-4791-4a5c-91bb-165322a699b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:52.913641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:52.914832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:52.915765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:52.915765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:52.915765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:52.915765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 549/1073] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:52.921305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ec598-894a-49b6-9e8a-06dddb26bde4 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:52.960512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:53.006039 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5eb0a-c24a-459d-944d-fa08829f4942 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:53.006302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5eb0a-c24a-459d-944d-fa08829f4942 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:53.006792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5eb0a-c24a-459d-944d-fa08829f4942 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:53.008139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 550/1074] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:53.012970 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9bbc-e815-4013-aeda-72bd9019f6a2 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:53.013219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9bbc-e815-4013-aeda-72bd9019f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:53.013499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9bbc-e815-4013-aeda-72bd9019f6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:53.030747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ec598-894a-49b6-9e8a-06dddb26bde4 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:53.033889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-9a5d9bbc-e815-4013-aeda-72bd9019f6a2 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:53.035107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9a5d9bbc-e815-4013-aeda-72bd9019f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:53.066588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c3863-fe6b-4fca-bde3-62763991c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:53.067199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c3863-fe6b-4fca-bde3-62763991c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:53.067473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c3863-fe6b-4fca-bde3-62763991c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:53.067743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c3863-fe6b-4fca-bde3-62763991c5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:53.068397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c3863-fe6b-4fca-bde3-62763991c5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:53.068714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c3863-fe6b-4fca-bde3-62763991c5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:53.070095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c3863-fe6b-4fca-bde3-62763991c5c7 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:53.081241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 525/1075] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:53.086956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c3863-fe6b-4fca-bde3-62763991c5c7 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:53.103652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 551/1076] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:14:53.184078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:53.191713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c3863-fe6b-4fca-bde3-62763991c5c7 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:53.226443 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7303d2c-7cc6-4c88-8339-3abfaa15eff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:53.226990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7303d2c-7cc6-4c88-8339-3abfaa15eff9 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:53.227267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7303d2c-7cc6-4c88-8339-3abfaa15eff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:53.227537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7303d2c-7cc6-4c88-8339-3abfaa15eff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:53.234481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7303d2c-7cc6-4c88-8339-3abfaa15eff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:53.235927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7303d2c-7cc6-4c88-8339-3abfaa15eff9 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-f7303d2c-7cc6-4c88-8339-3abfaa15eff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:53.247132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:53.248062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:53.249232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:53.249232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:53.249232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:53.249232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:53.249232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:53.249232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:53.249232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:53.249232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:53.249232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 526/1077] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:53.254707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d9bbc-e815-4013-aeda-72bd9019f6a2 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:53.343867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:53.359293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d9bbc-e815-4013-aeda-72bd9019f6a2 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:53.370579 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7303d2c-7cc6-4c88-8339-3abfaa15eff9 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:53.394753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc89951-ec80-4488-8147-4711183807e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:53.395366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc89951-ec80-4488-8147-4711183807e1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:53.395675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc89951-ec80-4488-8147-4711183807e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:53.395907 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc89951-ec80-4488-8147-4711183807e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:53.396630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc89951-ec80-4488-8147-4711183807e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:53.396936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc89951-ec80-4488-8147-4711183807e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:53.398383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc89951-ec80-4488-8147-4711183807e1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:53.410061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 552/1078] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:53.416196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc89951-ec80-4488-8147-4711183807e1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:53.474308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7303d2c-7cc6-4c88-8339-3abfaa15eff9 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:53.507716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5485c1b-5020-497a-b605-bb36837d1118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:53.508270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5485c1b-5020-497a-b605-bb36837d1118 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:53.508575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5485c1b-5020-497a-b605-bb36837d1118 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:53.508850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5485c1b-5020-497a-b605-bb36837d1118 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:53.516280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc89951-ec80-4488-8147-4711183807e1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:53.519582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5485c1b-5020-497a-b605-bb36837d1118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-d5485c1b-5020-497a-b605-bb36837d1118 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:53.524371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:53.525359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:53.526214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 527/1079] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:53.531655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5485c1b-5020-497a-b605-bb36837d1118 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:53.549883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:53.551770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbdb03-b925-41b9-8e35-5abe5e2de677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:53.552533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbdb03-b925-41b9-8e35-5abe5e2de677 None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:53.552849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbdb03-b925-41b9-8e35-5abe5e2de677 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:53.553120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbdb03-b925-41b9-8e35-5abe5e2de677 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/f9988b9fef5c4d559b1918ffe040aaa8/roles/aeb8c8c7dec042a5b67f19964036c92a` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:53.555332 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbdb03-b925-41b9-8e35-5abe5e2de677 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=f9988b9fef5c4d559b1918ffe040aaa8, role_id=aeb8c8c7dec042a5b67f19964036c92a)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:53.556923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbdb03-b925-41b9-8e35-5abe5e2de677 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:53.570835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 553/1080] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:14:53 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/f9988b9fef5c4d559b1918ffe040aaa8/roles/aeb8c8c7dec042a5b67f19964036c92a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:14:53.637825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5485c1b-5020-497a-b605-bb36837d1118 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:53.674821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17836ba-9ae4-43d9-8f75-23c43d94ed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:53.675568 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17836ba-9ae4-43d9-8f75-23c43d94ed87 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:53.675845 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17836ba-9ae4-43d9-8f75-23c43d94ed87 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:53.676115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17836ba-9ae4-43d9-8f75-23c43d94ed87 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:53.676840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17836ba-9ae4-43d9-8f75-23c43d94ed87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:53.677143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17836ba-9ae4-43d9-8f75-23c43d94ed87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:53.678570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17836ba-9ae4-43d9-8f75-23c43d94ed87 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:53.688707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 528/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:53.695529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbdb03-b925-41b9-8e35-5abe5e2de677 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:53.705803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:53.806579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbdb03-b925-41b9-8e35-5abe5e2de677 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:53.839076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02777cb-a405-4bb5-aee0-b6e3d36207f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:53.839703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02777cb-a405-4bb5-aee0-b6e3d36207f4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:53.839954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02777cb-a405-4bb5-aee0-b6e3d36207f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:53.840248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02777cb-a405-4bb5-aee0-b6e3d36207f4 None admin] PATH_INFO: `/v3/users/e8e0fa6be349400bb93cf06d8e9d4dd9` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:53.841468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02777cb-a405-4bb5-aee0-b6e3d36207f4 None admin] RBAC: Authorizing `identity:get_user(user_id=e8e0fa6be349400bb93cf06d8e9d4dd9)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:53.842955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02777cb-a405-4bb5-aee0-b6e3d36207f4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:53.844590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 554/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:14:53 2022] GET /identity/v3/users/e8e0fa6be349400bb93cf06d8e9d4dd9 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:53.850469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17836ba-9ae4-43d9-8f75-23c43d94ed87 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:53.931238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:53.955415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17836ba-9ae4-43d9-8f75-23c43d94ed87 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:53.990090 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c79f4e-d945-409d-8dff-55e5bcf3b1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:53.990728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c79f4e-d945-409d-8dff-55e5bcf3b1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:53.991001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c79f4e-d945-409d-8dff-55e5bcf3b1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:53.991224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c79f4e-d945-409d-8dff-55e5bcf3b1a4 None admin] PATH_INFO: `/v3/projects/d1f7d380a12d4408a29afc14935da681` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:53.992416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c79f4e-d945-409d-8dff-55e5bcf3b1a4 None admin] RBAC: Authorizing `identity:get_project(project_id=d1f7d380a12d4408a29afc14935da681)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:53.993864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c79f4e-d945-409d-8dff-55e5bcf3b1a4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:53.995490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 529/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:14:53 2022] GET /identity/v3/projects/d1f7d380a12d4408a29afc14935da681 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:54.001852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02777cb-a405-4bb5-aee0-b6e3d36207f4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:54.082278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:54.109895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02777cb-a405-4bb5-aee0-b6e3d36207f4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:54.145202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99732d40-6f4c-4e7b-9109-5157ea6b3363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:54.145857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99732d40-6f4c-4e7b-9109-5157ea6b3363 None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:54.146134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99732d40-6f4c-4e7b-9109-5157ea6b3363 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:54.146406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99732d40-6f4c-4e7b-9109-5157ea6b3363 None admin] PATH_INFO: `/v3/projects/d1f7d380a12d4408a29afc14935da681/users/e8e0fa6be349400bb93cf06d8e9d4dd9/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:54.148353 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99732d40-6f4c-4e7b-9109-5157ea6b3363 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1f7d380a12d4408a29afc14935da681, user_id=e8e0fa6be349400bb93cf06d8e9d4dd9, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:54.149823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99732d40-6f4c-4e7b-9109-5157ea6b3363 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:54.164981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 555/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:14:54 2022] PUT /identity/v3/projects/d1f7d380a12d4408a29afc14935da681/users/e8e0fa6be349400bb93cf06d8e9d4dd9/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:14:55.701765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506b4cd-cfb8-4676-977c-594ed086c95c None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:55.702361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506b4cd-cfb8-4676-977c-594ed086c95c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:55.702361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506b4cd-cfb8-4676-977c-594ed086c95c None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:55.703635 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 530/1085] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:55.709193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4738-51a9-40f8-8873-fd7a60e0a2c8 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:55.709616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4738-51a9-40f8-8873-fd7a60e0a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:55.709730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4738-51a9-40f8-8873-fd7a60e0a2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:55.729500 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-c64f4738-51a9-40f8-8873-fd7a60e0a2c8 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:55.730723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c64f4738-51a9-40f8-8873-fd7a60e0a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:55.802264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 556/1086] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:56.063321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506b4cd-cfb8-4676-977c-594ed086c95c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:56.170921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506b4cd-cfb8-4676-977c-594ed086c95c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:56.206661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a36c3b-6766-4a80-8473-1ada05c26712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:56.207283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36c3b-6766-4a80-8473-1ada05c26712 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:56.207554 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36c3b-6766-4a80-8473-1ada05c26712 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:56.207805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36c3b-6766-4a80-8473-1ada05c26712 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:56.218054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a36c3b-6766-4a80-8473-1ada05c26712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-01a36c3b-6766-4a80-8473-1ada05c26712 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:56.222963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:56.224015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:56.224913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 531/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Sep 16 19:14:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:56.230916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4738-51a9-40f8-8873-fd7a60e0a2c8 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:56.297640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:56.339199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4738-51a9-40f8-8873-fd7a60e0a2c8 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:56.348362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38302d-3432-4005-8b21-80e0bcea03fb None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:56.348671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38302d-3432-4005-8b21-80e0bcea03fb None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:56.348942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38302d-3432-4005-8b21-80e0bcea03fb None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:56.351121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 532/1088] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:14:56.355889 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba56f5-5f41-41b7-934d-da7872d9fd50 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:56.356191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba56f5-5f41-41b7-934d-da7872d9fd50 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:56.356496 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba56f5-5f41-41b7-934d-da7872d9fd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:56.369725 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:56.376492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-91ba56f5-5f41-41b7-934d-da7872d9fd50 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:56.377696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-91ba56f5-5f41-41b7-934d-da7872d9fd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:56.377877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a5586-0251-43f9-af7e-75483c49116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:56.378495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a5586-0251-43f9-af7e-75483c49116a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:56.378771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a5586-0251-43f9-af7e-75483c49116a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:56.379043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a5586-0251-43f9-af7e-75483c49116a None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:56.379713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a5586-0251-43f9-af7e-75483c49116a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:56.380016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a5586-0251-43f9-af7e-75483c49116a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:56.381423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a5586-0251-43f9-af7e-75483c49116a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:56.389822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 557/1089] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Sep 16 19:14:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:56.396170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a5586-0251-43f9-af7e-75483c49116a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:56.446357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 533/1090] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:14:56.496729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a5586-0251-43f9-af7e-75483c49116a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:56.521660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:56.530942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84840b-9d73-4ea7-8884-a6a94b0a5d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:56.531567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84840b-9d73-4ea7-8884-a6a94b0a5d87 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:56.531838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84840b-9d73-4ea7-8884-a6a94b0a5d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:56.532104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84840b-9d73-4ea7-8884-a6a94b0a5d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:56.542275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84840b-9d73-4ea7-8884-a6a94b0a5d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:56.543721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84840b-9d73-4ea7-8884-a6a94b0a5d87 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-4c84840b-9d73-4ea7-8884-a6a94b0a5d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:56.557559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:56.558519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:56.559431 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:56.559431 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:56.559431 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:56.559431 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 558/1091] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:56.564644 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba56f5-5f41-41b7-934d-da7872d9fd50 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:56.662025 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba56f5-5f41-41b7-934d-da7872d9fd50 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:56.696985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1991b8-6fa0-4ebb-9042-a2a2bf9c2007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:56.697595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1991b8-6fa0-4ebb-9042-a2a2bf9c2007 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:56.697916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1991b8-6fa0-4ebb-9042-a2a2bf9c2007 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:56.698163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1991b8-6fa0-4ebb-9042-a2a2bf9c2007 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:56.698798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1991b8-6fa0-4ebb-9042-a2a2bf9c2007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:56.699090 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1991b8-6fa0-4ebb-9042-a2a2bf9c2007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:56.700475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1991b8-6fa0-4ebb-9042-a2a2bf9c2007 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:56.703114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:56.711451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84840b-9d73-4ea7-8884-a6a94b0a5d87 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:56.713037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 534/1092] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:56.718519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1991b8-6fa0-4ebb-9042-a2a2bf9c2007 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:56.814795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84840b-9d73-4ea7-8884-a6a94b0a5d87 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:56.817030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1991b8-6fa0-4ebb-9042-a2a2bf9c2007 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:56.847406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3ca6a-6cbc-4801-8c9d-3bb2c94c6b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:56.848027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3ca6a-6cbc-4801-8c9d-3bb2c94c6b40 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:56.848302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3ca6a-6cbc-4801-8c9d-3bb2c94c6b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:56.848599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3ca6a-6cbc-4801-8c9d-3bb2c94c6b40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:56.849780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac4e4b-922e-45e6-84d0-25904af713ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:56.850409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac4e4b-922e-45e6-84d0-25904af713ad None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:56.850685 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac4e4b-922e-45e6-84d0-25904af713ad None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:56.850958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac4e4b-922e-45e6-84d0-25904af713ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:56.858577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac4e4b-922e-45e6-84d0-25904af713ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:56.859405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3ca6a-6cbc-4801-8c9d-3bb2c94c6b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:14:56.860027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac4e4b-922e-45e6-84d0-25904af713ad None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-e7a3ca6a-6cbc-4801-8c9d-3bb2c94c6b40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:14:56.864167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:56.865311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:14:56.866208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 559/1093] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:14:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:14:56.871342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3ca6a-6cbc-4801-8c9d-3bb2c94c6b40 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-b9ac4e4b-922e-45e6-84d0-25904af713ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:14:56.872915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:56.874357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:56.875301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 535/1094] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Sep 16 19:14:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:56.879592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac4e4b-922e-45e6-84d0-25904af713ad None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:56.915422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:56.935893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:56.976262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3ca6a-6cbc-4801-8c9d-3bb2c94c6b40 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:56.979614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac4e4b-922e-45e6-84d0-25904af713ad None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:57.009441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7a920-ee0b-4fb9-8468-0f36fa1bc3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:57.010072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a920-ee0b-4fb9-8468-0f36fa1bc3bb None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:57.010342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a920-ee0b-4fb9-8468-0f36fa1bc3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:57.010603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a920-ee0b-4fb9-8468-0f36fa1bc3bb None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:57.011262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7a920-ee0b-4fb9-8468-0f36fa1bc3bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:57.011560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7a920-ee0b-4fb9-8468-0f36fa1bc3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:57.012652 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224c7ca-d506-4ac0-8201-32e0f8152d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:57.012966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7a920-ee0b-4fb9-8468-0f36fa1bc3bb None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:57.013342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224c7ca-d506-4ac0-8201-32e0f8152d6f None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:57.013612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224c7ca-d506-4ac0-8201-32e0f8152d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:57.014064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224c7ca-d506-4ac0-8201-32e0f8152d6f None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:57.014781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224c7ca-d506-4ac0-8201-32e0f8152d6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:57.015093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224c7ca-d506-4ac0-8201-32e0f8152d6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:57.016508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224c7ca-d506-4ac0-8201-32e0f8152d6f None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:57.023225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 560/1095] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:14:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:57.029625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7a920-ee0b-4fb9-8468-0f36fa1bc3bb None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:57.042004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 536/1096] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Sep 16 19:14:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:57.043117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224c7ca-d506-4ac0-8201-32e0f8152d6f None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:57.123070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:57.126613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7a920-ee0b-4fb9-8468-0f36fa1bc3bb None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:57.142611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224c7ca-d506-4ac0-8201-32e0f8152d6f None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:57.157356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:57.162370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212188-cfd4-4f24-99b0-a58ff65192f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:57.163006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212188-cfd4-4f24-99b0-a58ff65192f1 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:57.163281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212188-cfd4-4f24-99b0-a58ff65192f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:57.163553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212188-cfd4-4f24-99b0-a58ff65192f1 None admin] PATH_INFO: `/v3/users/e8e0fa6be349400bb93cf06d8e9d4dd9` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:57.164798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212188-cfd4-4f24-99b0-a58ff65192f1 None admin] RBAC: Authorizing `identity:get_user(user_id=e8e0fa6be349400bb93cf06d8e9d4dd9)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:57.166294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212188-cfd4-4f24-99b0-a58ff65192f1 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:57.167854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 561/1097] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:14:57 2022] GET /identity/v3/users/e8e0fa6be349400bb93cf06d8e9d4dd9 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:57.173869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212188-cfd4-4f24-99b0-a58ff65192f1 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:57.178685 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55360-43a6-4b20-a0f3-80a6054d4bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:57.179319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55360-43a6-4b20-a0f3-80a6054d4bff None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:57.179589 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55360-43a6-4b20-a0f3-80a6054d4bff None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:57.179853 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55360-43a6-4b20-a0f3-80a6054d4bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:57.246313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a55360-43a6-4b20-a0f3-80a6054d4bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:57.247848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a55360-43a6-4b20-a0f3-80a6054d4bff None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:57.272583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212188-cfd4-4f24-99b0-a58ff65192f1 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:57.307642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa480860-61a8-45a3-9faa-818d1944c272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:57.308331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480860-61a8-45a3-9faa-818d1944c272 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:57.308637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480860-61a8-45a3-9faa-818d1944c272 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:57.308912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480860-61a8-45a3-9faa-818d1944c272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:57.344561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 537/1098] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 19:14:57.351249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:57.351386 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55360-43a6-4b20-a0f3-80a6054d4bff None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:57.365521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:57.383615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa480860-61a8-45a3-9faa-818d1944c272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:57.385115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa480860-61a8-45a3-9faa-818d1944c272 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:57.451973 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55360-43a6-4b20-a0f3-80a6054d4bff None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:57.484250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 562/1099] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:14:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:14:57.486936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9397c-3672-432a-a235-da94feb41b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:57.487574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9397c-3672-432a-a235-da94feb41b56 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:57.487848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9397c-3672-432a-a235-da94feb41b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:57.488113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9397c-3672-432a-a235-da94feb41b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:57.491558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa480860-61a8-45a3-9faa-818d1944c272 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:57.499137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9397c-3672-432a-a235-da94feb41b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:57.500627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9397c-3672-432a-a235-da94feb41b56 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-e5e9397c-3672-432a-a235-da94feb41b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:14:57.516125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:57.517329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:14:57.518326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:14:57.518326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:14:57.518326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:57.518326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 538/1100] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:57.522945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9397c-3672-432a-a235-da94feb41b56 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:57.555895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:57.589934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa480860-61a8-45a3-9faa-818d1944c272 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:57.592919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:57.625874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953a1b3-38db-44b9-9da4-1b68dec5434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:57.626516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953a1b3-38db-44b9-9da4-1b68dec5434a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:57.626793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953a1b3-38db-44b9-9da4-1b68dec5434a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:57.627061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953a1b3-38db-44b9-9da4-1b68dec5434a None admin] PATH_INFO: `/v3/projects/d1f7d380a12d4408a29afc14935da681` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:57.628192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953a1b3-38db-44b9-9da4-1b68dec5434a None admin] RBAC: Authorizing `identity:get_project(project_id=d1f7d380a12d4408a29afc14935da681)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:57.629674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953a1b3-38db-44b9-9da4-1b68dec5434a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:57.631330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 563/1101] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:14:57 2022] GET /identity/v3/projects/d1f7d380a12d4408a29afc14935da681 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:14:57.632339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9397c-3672-432a-a235-da94feb41b56 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:57.637479 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953a1b3-38db-44b9-9da4-1b68dec5434a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:57.666274 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249b6dd-9d39-4d63-89b5-eb7a2d75e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:57.666879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249b6dd-9d39-4d63-89b5-eb7a2d75e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:57.667156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249b6dd-9d39-4d63-89b5-eb7a2d75e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:57.667435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249b6dd-9d39-4d63-89b5-eb7a2d75e1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:57.668068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249b6dd-9d39-4d63-89b5-eb7a2d75e1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:57.668366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249b6dd-9d39-4d63-89b5-eb7a2d75e1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:57.670428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249b6dd-9d39-4d63-89b5-eb7a2d75e1b1 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:57.682060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 539/1102] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:57.687665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249b6dd-9d39-4d63-89b5-eb7a2d75e1b1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:57.737269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953a1b3-38db-44b9-9da4-1b68dec5434a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:57.774624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b2a7c-89cb-405d-a693-21a1e7b287fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:57.775248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2a7c-89cb-405d-a693-21a1e7b287fb None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:57.775539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2a7c-89cb-405d-a693-21a1e7b287fb None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:57.775787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2a7c-89cb-405d-a693-21a1e7b287fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:57.776556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b2a7c-89cb-405d-a693-21a1e7b287fb None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=d1f7d380a12d4408a29afc14935da681, user.id=e8e0fa6be349400bb93cf06d8e9d4dd9) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:57.776860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b2a7c-89cb-405d-a693-21a1e7b287fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:57.778315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b2a7c-89cb-405d-a693-21a1e7b287fb None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:57.781325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:57.785104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 564/1103] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:57 2022] GET /identity/v3/role_assignments?user.id=e8e0fa6be349400bb93cf06d8e9d4dd9&scope.project.id=d1f7d380a12d4408a29afc14935da681&role.id=71bed99a52684ba990097719b40ef99d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:57.790964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249b6dd-9d39-4d63-89b5-eb7a2d75e1b1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:57.822436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:57.833449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03399e8-bb1b-49ac-a69e-3d54dd51df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:57.834094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03399e8-bb1b-49ac-a69e-3d54dd51df70 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:57.834370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03399e8-bb1b-49ac-a69e-3d54dd51df70 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:57.834636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03399e8-bb1b-49ac-a69e-3d54dd51df70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:57.842789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03399e8-bb1b-49ac-a69e-3d54dd51df70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:57.844277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03399e8-bb1b-49ac-a69e-3d54dd51df70 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-c03399e8-bb1b-49ac-a69e-3d54dd51df70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:14:57.859459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:14:57.860600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:14:57.862195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:14:57.862195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:14:57.862195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:14:57.862195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:14:57.862195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:14:57.862195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:14:57.862195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:14:57.862195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:14:57.862195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 540/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:14:57.866951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b2a7c-89cb-405d-a693-21a1e7b287fb None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:57.981307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b2a7c-89cb-405d-a693-21a1e7b287fb None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:58.017222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea0e92-58ba-4a0a-9a68-5be56018836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:58.017843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0e92-58ba-4a0a-9a68-5be56018836b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:58.018117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0e92-58ba-4a0a-9a68-5be56018836b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:58.018408 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0e92-58ba-4a0a-9a68-5be56018836b None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:58.019074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea0e92-58ba-4a0a-9a68-5be56018836b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:58.019374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea0e92-58ba-4a0a-9a68-5be56018836b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:58.020910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea0e92-58ba-4a0a-9a68-5be56018836b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:58.034087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 565/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:58.040318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03399e8-bb1b-49ac-a69e-3d54dd51df70 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:58.145867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03399e8-bb1b-49ac-a69e-3d54dd51df70 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:58.181478 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b850596-5268-4d07-bfb0-64a4cd1281da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:58.182101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b850596-5268-4d07-bfb0-64a4cd1281da None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:58.182380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b850596-5268-4d07-bfb0-64a4cd1281da None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:58.182651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b850596-5268-4d07-bfb0-64a4cd1281da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:58.183390 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b850596-5268-4d07-bfb0-64a4cd1281da None admin] RBAC: Adding query filter params (role.id=aeb8c8c7dec042a5b67f19964036c92a, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=f9988b9fef5c4d559b1918ffe040aaa8) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:58.183703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b850596-5268-4d07-bfb0-64a4cd1281da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:58.185208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b850596-5268-4d07-bfb0-64a4cd1281da None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:58.192081 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 541/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:14:58 2022] GET /identity/v3/role_assignments?user.id=f9988b9fef5c4d559b1918ffe040aaa8&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=aeb8c8c7dec042a5b67f19964036c92a => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:59.962480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc829f-5e7e-42b5-8bad-c3c47f7ea759 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:59.963070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc829f-5e7e-42b5-8bad-c3c47f7ea759 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:59.963070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc829f-5e7e-42b5-8bad-c3c47f7ea759 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:59.964360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 566/1107] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:59.970777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b5e47-f2d8-4f73-8389-d0ebbef677ff None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:59.971468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b5e47-f2d8-4f73-8389-d0ebbef677ff None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:59.971614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b5e47-f2d8-4f73-8389-d0ebbef677ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:59.995231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-df9b5e47-f2d8-4f73-8389-d0ebbef677ff None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:59.996423 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-df9b5e47-f2d8-4f73-8389-d0ebbef677ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:00.045493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:00.067165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 542/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:14:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:00.330853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc829f-5e7e-42b5-8bad-c3c47f7ea759 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:00.402944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:00.451903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc829f-5e7e-42b5-8bad-c3c47f7ea759 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:00.494025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbfdaa-a6c1-49a2-9828-a0de195e5ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:00.494659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbfdaa-a6c1-49a2-9828-a0de195e5ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:00.494930 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbfdaa-a6c1-49a2-9828-a0de195e5ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:00.495196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbfdaa-a6c1-49a2-9828-a0de195e5ef3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:00.496405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbfdaa-a6c1-49a2-9828-a0de195e5ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:00.497872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbfdaa-a6c1-49a2-9828-a0de195e5ef3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:00.499491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 567/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:15:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:00.508719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b5e47-f2d8-4f73-8389-d0ebbef677ff None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:00.627221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b5e47-f2d8-4f73-8389-d0ebbef677ff None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:00.663662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582baba9-1066-4644-93f9-2415058d3a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:00.664263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582baba9-1066-4644-93f9-2415058d3a79 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:00.664570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582baba9-1066-4644-93f9-2415058d3a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:00.664838 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582baba9-1066-4644-93f9-2415058d3a79 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:00.665491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582baba9-1066-4644-93f9-2415058d3a79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:00.666924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582baba9-1066-4644-93f9-2415058d3a79 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:00.694622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 543/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:15:00 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:15:02.862732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723a0b-12b8-4eab-9c40-763ee61ff348 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:02.863332 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723a0b-12b8-4eab-9c40-763ee61ff348 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:02.863332 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723a0b-12b8-4eab-9c40-763ee61ff348 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:02.864654 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 568/1111] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:02.870224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690807-e1bc-4809-b1d9-7dd9733da984 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:02.870657 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690807-e1bc-4809-b1d9-7dd9733da984 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:02.870767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690807-e1bc-4809-b1d9-7dd9733da984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:02.890760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-67690807-e1bc-4809-b1d9-7dd9733da984 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:02.891923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-67690807-e1bc-4809-b1d9-7dd9733da984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:02.921233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:02.962013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 544/1112] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:03.224134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5723a0b-12b8-4eab-9c40-763ee61ff348 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:03.345108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5723a0b-12b8-4eab-9c40-763ee61ff348 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:03.380651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:03.393663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b266fd-15d0-41c3-bcfa-daed2ac35042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:03.394379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b266fd-15d0-41c3-bcfa-daed2ac35042 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:03.394811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b266fd-15d0-41c3-bcfa-daed2ac35042 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:03.395085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b266fd-15d0-41c3-bcfa-daed2ac35042 None admin] PATH_INFO: `/v3/roles/e157fabaf96640bf8a975076a70c720d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:03.396894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b266fd-15d0-41c3-bcfa-daed2ac35042 None admin] RBAC: Authorizing `identity:get_role(role_id=e157fabaf96640bf8a975076a70c720d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:03.398913 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b266fd-15d0-41c3-bcfa-daed2ac35042 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:03.400967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 569/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:03 2022] GET /identity/v3/roles/e157fabaf96640bf8a975076a70c720d => generated 223 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:03.407966 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67690807-e1bc-4809-b1d9-7dd9733da984 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:03.513472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67690807-e1bc-4809-b1d9-7dd9733da984 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:03.552407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478df3bd-5cd1-43d0-95bb-a805631212ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:03.553057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df3bd-5cd1-43d0-95bb-a805631212ca None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:03.553335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df3bd-5cd1-43d0-95bb-a805631212ca None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:03.553601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df3bd-5cd1-43d0-95bb-a805631212ca None admin] PATH_INFO: `/v3/users/1983b83df16b42d283c3f17fa0652d2b` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:03.569074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478df3bd-5cd1-43d0-95bb-a805631212ca None admin] RBAC: Authorizing `identity:get_user(user_id=1983b83df16b42d283c3f17fa0652d2b)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:03.570528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478df3bd-5cd1-43d0-95bb-a805631212ca None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:03.572126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 545/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:03 2022] GET /identity/v3/users/1983b83df16b42d283c3f17fa0652d2b => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:03.578526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b266fd-15d0-41c3-bcfa-daed2ac35042 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:03.685297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b266fd-15d0-41c3-bcfa-daed2ac35042 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:03.722215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337cb25-f9ff-40b4-8f5c-cb4c550c417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:03.722821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337cb25-f9ff-40b4-8f5c-cb4c550c417d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:03.723093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337cb25-f9ff-40b4-8f5c-cb4c550c417d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:03.723358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337cb25-f9ff-40b4-8f5c-cb4c550c417d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:03.785712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:03.793184 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337cb25-f9ff-40b4-8f5c-cb4c550c417d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:03.794713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337cb25-f9ff-40b4-8f5c-cb4c550c417d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:03.893510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 570/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:15:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:15:03.903126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478df3bd-5cd1-43d0-95bb-a805631212ca None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:03.929163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:04.009542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478df3bd-5cd1-43d0-95bb-a805631212ca None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:04.047054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178b880-6e88-458b-8fb3-6ba69727d763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:04.047602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178b880-6e88-458b-8fb3-6ba69727d763 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:04.047875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178b880-6e88-458b-8fb3-6ba69727d763 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:04.048140 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178b880-6e88-458b-8fb3-6ba69727d763 None admin] PATH_INFO: `/v3/projects/d1f7d380a12d4408a29afc14935da681` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:04.049399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178b880-6e88-458b-8fb3-6ba69727d763 None admin] RBAC: Authorizing `identity:get_project(project_id=d1f7d380a12d4408a29afc14935da681)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:04.050823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178b880-6e88-458b-8fb3-6ba69727d763 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:04.052411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 546/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:15:03 2022] GET /identity/v3/projects/d1f7d380a12d4408a29afc14935da681 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:04.058840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337cb25-f9ff-40b4-8f5c-cb4c550c417d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:04.159010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:04.169478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337cb25-f9ff-40b4-8f5c-cb4c550c417d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:04.205838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca770d30-289c-4c42-81ae-567d669eaebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:04.206440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca770d30-289c-4c42-81ae-567d669eaebb None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:04.206717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca770d30-289c-4c42-81ae-567d669eaebb None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:04.206989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca770d30-289c-4c42-81ae-567d669eaebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:04.207708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca770d30-289c-4c42-81ae-567d669eaebb None admin] RBAC: Adding query filter params (role.id=e157fabaf96640bf8a975076a70c720d, scope.project.id=d1f7d380a12d4408a29afc14935da681, user.id=1983b83df16b42d283c3f17fa0652d2b) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:04.208011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca770d30-289c-4c42-81ae-567d669eaebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:04.209477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca770d30-289c-4c42-81ae-567d669eaebb None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:04.214824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 571/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:15:04 2022] GET /identity/v3/role_assignments?user.id=1983b83df16b42d283c3f17fa0652d2b&scope.project.id=d1f7d380a12d4408a29afc14935da681&role.id=e157fabaf96640bf8a975076a70c720d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:06.339853 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d2316-de8d-4273-852f-eccac67bda05 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:06.340845 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d2316-de8d-4273-852f-eccac67bda05 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:06.340981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d2316-de8d-4273-852f-eccac67bda05 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:06.342483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 547/1118] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:06.348197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0d504-fd51-413c-91a2-ef2f61cce8e3 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:06.348709 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0d504-fd51-413c-91a2-ef2f61cce8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:06.348816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0d504-fd51-413c-91a2-ef2f61cce8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:06.368409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-64b0d504-fd51-413c-91a2-ef2f61cce8e3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:06.369619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-64b0d504-fd51-413c-91a2-ef2f61cce8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:06.445955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 572/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:06.716087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d2316-de8d-4273-852f-eccac67bda05 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:06.822751 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:06.840857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d2316-de8d-4273-852f-eccac67bda05 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:06.879983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3f534-93c4-4265-98ab-62328aa356be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:06.880642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3f534-93c4-4265-98ab-62328aa356be None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:06.880926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3f534-93c4-4265-98ab-62328aa356be None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:06.881201 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3f534-93c4-4265-98ab-62328aa356be None admin] PATH_INFO: `/v3/roles/e157fabaf96640bf8a975076a70c720d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:06.882647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3f534-93c4-4265-98ab-62328aa356be None admin] RBAC: Authorizing `identity:get_role(role_id=e157fabaf96640bf8a975076a70c720d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:06.884017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3f534-93c4-4265-98ab-62328aa356be None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:06.885417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 548/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:06 2022] GET /identity/v3/roles/e157fabaf96640bf8a975076a70c720d => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:06.894951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0d504-fd51-413c-91a2-ef2f61cce8e3 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:06.995961 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:07.007585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0d504-fd51-413c-91a2-ef2f61cce8e3 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:07.045864 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd0e94-6486-49fa-9fcd-14d411c218d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:07.046510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd0e94-6486-49fa-9fcd-14d411c218d7 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:07.046787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd0e94-6486-49fa-9fcd-14d411c218d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:07.047045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd0e94-6486-49fa-9fcd-14d411c218d7 None admin] PATH_INFO: `/v3/users/1983b83df16b42d283c3f17fa0652d2b` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:07.048267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd0e94-6486-49fa-9fcd-14d411c218d7 None admin] RBAC: Authorizing `identity:get_user(user_id=1983b83df16b42d283c3f17fa0652d2b)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:07.049755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd0e94-6486-49fa-9fcd-14d411c218d7 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:07.051368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 573/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:06 2022] GET /identity/v3/users/1983b83df16b42d283c3f17fa0652d2b => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:07.061183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3f534-93c4-4265-98ab-62328aa356be None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:07.179478 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3f534-93c4-4265-98ab-62328aa356be None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:07.213842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc12786-2186-42c8-958e-aecadbb06528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:07.214456 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc12786-2186-42c8-958e-aecadbb06528 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:07.214733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc12786-2186-42c8-958e-aecadbb06528 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:07.214995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc12786-2186-42c8-958e-aecadbb06528 None admin] PATH_INFO: `/v3/projects/d1f7d380a12d4408a29afc14935da681` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:07.216292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc12786-2186-42c8-958e-aecadbb06528 None admin] RBAC: Authorizing `identity:get_project(project_id=d1f7d380a12d4408a29afc14935da681)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:07.217754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc12786-2186-42c8-958e-aecadbb06528 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:07.219356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 549/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:15:07 2022] GET /identity/v3/projects/d1f7d380a12d4408a29afc14935da681 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:07.228423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd0e94-6486-49fa-9fcd-14d411c218d7 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:07.330381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd0e94-6486-49fa-9fcd-14d411c218d7 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:07.365471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f306f7-eb3a-47c6-bec3-7a509c42a625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:07.366103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f306f7-eb3a-47c6-bec3-7a509c42a625 None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:07.366371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f306f7-eb3a-47c6-bec3-7a509c42a625 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:07.366646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f306f7-eb3a-47c6-bec3-7a509c42a625 None admin] PATH_INFO: `/v3/projects/d1f7d380a12d4408a29afc14935da681/users/1983b83df16b42d283c3f17fa0652d2b/roles/e157fabaf96640bf8a975076a70c720d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:07.369159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f306f7-eb3a-47c6-bec3-7a509c42a625 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1f7d380a12d4408a29afc14935da681, user_id=1983b83df16b42d283c3f17fa0652d2b, role_id=e157fabaf96640bf8a975076a70c720d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:07.370599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f306f7-eb3a-47c6-bec3-7a509c42a625 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:07.387496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 574/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:15:07 2022] PUT /identity/v3/projects/d1f7d380a12d4408a29afc14935da681/users/1983b83df16b42d283c3f17fa0652d2b/roles/e157fabaf96640bf8a975076a70c720d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:15:09.530368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b262f3-d0e3-4b08-9961-5b213bdb8a4d None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:09.531308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b262f3-d0e3-4b08-9961-5b213bdb8a4d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:09.531308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b262f3-d0e3-4b08-9961-5b213bdb8a4d None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:09.533410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 550/1124] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:09.538960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1c9bc-015c-4671-a378-00d35e51577c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:09.539413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1c9bc-015c-4671-a378-00d35e51577c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:09.539512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1c9bc-015c-4671-a378-00d35e51577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:09.558859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1ab1c9bc-015c-4671-a378-00d35e51577c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:09.560639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1ab1c9bc-015c-4671-a378-00d35e51577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:09.574581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:09.633995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 575/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:09.905069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b262f3-d0e3-4b08-9961-5b213bdb8a4d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:09.947341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:10.031810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b262f3-d0e3-4b08-9961-5b213bdb8a4d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:10.070329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932d3a-ac66-4e04-adbb-5114b74f238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:10.070951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932d3a-ac66-4e04-adbb-5114b74f238e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:10.071230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932d3a-ac66-4e04-adbb-5114b74f238e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:10.071503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932d3a-ac66-4e04-adbb-5114b74f238e None admin] PATH_INFO: `/v3/roles/e157fabaf96640bf8a975076a70c720d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:10.073070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da932d3a-ac66-4e04-adbb-5114b74f238e None admin] RBAC: Authorizing `identity:get_role(role_id=e157fabaf96640bf8a975076a70c720d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:10.074446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da932d3a-ac66-4e04-adbb-5114b74f238e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:10.075815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 551/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:09 2022] GET /identity/v3/roles/e157fabaf96640bf8a975076a70c720d => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:10.082000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1c9bc-015c-4671-a378-00d35e51577c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:10.195632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1c9bc-015c-4671-a378-00d35e51577c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:10.237009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322df537-9f71-40f1-9f9b-56e2eb56637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:10.237634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322df537-9f71-40f1-9f9b-56e2eb56637d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:10.237906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322df537-9f71-40f1-9f9b-56e2eb56637d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:10.238172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322df537-9f71-40f1-9f9b-56e2eb56637d None admin] PATH_INFO: `/v3/users/1983b83df16b42d283c3f17fa0652d2b` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:10.239308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322df537-9f71-40f1-9f9b-56e2eb56637d None admin] RBAC: Authorizing `identity:get_user(user_id=1983b83df16b42d283c3f17fa0652d2b)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:10.240799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322df537-9f71-40f1-9f9b-56e2eb56637d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:10.242353 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 576/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:10 2022] GET /identity/v3/users/1983b83df16b42d283c3f17fa0652d2b => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:10.251609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932d3a-ac66-4e04-adbb-5114b74f238e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:10.352806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:10.363859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932d3a-ac66-4e04-adbb-5114b74f238e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:10.409162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc38b8-a55e-4275-a936-a29342574992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:10.409760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc38b8-a55e-4275-a936-a29342574992 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:10.410036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc38b8-a55e-4275-a936-a29342574992 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:10.410309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc38b8-a55e-4275-a936-a29342574992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:10.487882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc38b8-a55e-4275-a936-a29342574992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:10.489279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc38b8-a55e-4275-a936-a29342574992 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:10.587500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:10.594878 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 552/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:15:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:15:10.601348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322df537-9f71-40f1-9f9b-56e2eb56637d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:10.621290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:10.704458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322df537-9f71-40f1-9f9b-56e2eb56637d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:10.745795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7299f-d884-4c28-b3da-927968d2b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:10.746672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7299f-d884-4c28-b3da-927968d2b18d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:10.747144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7299f-d884-4c28-b3da-927968d2b18d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:10.747411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7299f-d884-4c28-b3da-927968d2b18d None admin] PATH_INFO: `/v3/projects/d1f7d380a12d4408a29afc14935da681` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:10.748686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7299f-d884-4c28-b3da-927968d2b18d None admin] RBAC: Authorizing `identity:get_project(project_id=d1f7d380a12d4408a29afc14935da681)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:10.750196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7299f-d884-4c28-b3da-927968d2b18d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:10.751840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 577/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:15:10 2022] GET /identity/v3/projects/d1f7d380a12d4408a29afc14935da681 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:10.760695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc38b8-a55e-4275-a936-a29342574992 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:10.890569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc38b8-a55e-4275-a936-a29342574992 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:10.929595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447c912-7199-46d5-b50f-76d4450771a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:10.930195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c912-7199-46d5-b50f-76d4450771a4 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:10.930498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c912-7199-46d5-b50f-76d4450771a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:10.930733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c912-7199-46d5-b50f-76d4450771a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:10.931444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447c912-7199-46d5-b50f-76d4450771a4 None admin] RBAC: Adding query filter params (role.id=e157fabaf96640bf8a975076a70c720d, scope.project.id=d1f7d380a12d4408a29afc14935da681, user.id=1983b83df16b42d283c3f17fa0652d2b) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:10.931746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447c912-7199-46d5-b50f-76d4450771a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:10.933204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447c912-7199-46d5-b50f-76d4450771a4 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:10.939043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 553/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:15:10 2022] GET /identity/v3/role_assignments?user.id=1983b83df16b42d283c3f17fa0652d2b&scope.project.id=d1f7d380a12d4408a29afc14935da681&role.id=e157fabaf96640bf8a975076a70c720d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:13.094145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2647-e594-4308-96ea-985caf11ea83 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:13.094959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2647-e594-4308-96ea-985caf11ea83 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:13.094959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2647-e594-4308-96ea-985caf11ea83 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:13.097031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 578/1131] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:13.102572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177e2a0-750b-4025-bbf0-8e1f1e6817e1 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:13.102993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177e2a0-750b-4025-bbf0-8e1f1e6817e1 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:13.103105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177e2a0-750b-4025-bbf0-8e1f1e6817e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:13.123268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-9177e2a0-750b-4025-bbf0-8e1f1e6817e1 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:13.124482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9177e2a0-750b-4025-bbf0-8e1f1e6817e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:13.182719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:13.196921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 554/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:13.462134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce2647-e594-4308-96ea-985caf11ea83 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:13.563527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:13.584843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce2647-e594-4308-96ea-985caf11ea83 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:13.623542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f54f50-11b4-4126-b355-6eaf4f291704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:13.624430 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f54f50-11b4-4126-b355-6eaf4f291704 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:13.624770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f54f50-11b4-4126-b355-6eaf4f291704 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:13.625105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f54f50-11b4-4126-b355-6eaf4f291704 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:13.627017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f54f50-11b4-4126-b355-6eaf4f291704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:13.629338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f54f50-11b4-4126-b355-6eaf4f291704 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:13.631725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 579/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:15:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:13.641472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177e2a0-750b-4025-bbf0-8e1f1e6817e1 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:13.748355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177e2a0-750b-4025-bbf0-8e1f1e6817e1 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:13.785161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14470755-e93b-41b4-9aae-0b9f5524bd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:13.785765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14470755-e93b-41b4-9aae-0b9f5524bd1d None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:13.786044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14470755-e93b-41b4-9aae-0b9f5524bd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:13.786312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14470755-e93b-41b4-9aae-0b9f5524bd1d None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:13.786942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14470755-e93b-41b4-9aae-0b9f5524bd1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:13.788400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14470755-e93b-41b4-9aae-0b9f5524bd1d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:13.822237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 555/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:15:13 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:15:16.002562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a59c8-0a19-4fff-8793-aac389bd26ce None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:16.003449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a59c8-0a19-4fff-8793-aac389bd26ce None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:16.003449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a59c8-0a19-4fff-8793-aac389bd26ce None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:16.005614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 580/1135] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:16.014498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0ade-92ad-486b-b1bc-dd3bef7bdecc None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:16.014919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0ade-92ad-486b-b1bc-dd3bef7bdecc None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:16.015057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0ade-92ad-486b-b1bc-dd3bef7bdecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:16.039174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-598b0ade-92ad-486b-b1bc-dd3bef7bdecc None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:16.040296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-598b0ade-92ad-486b-b1bc-dd3bef7bdecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:16.077666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:16.110110 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 556/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:15:16.376495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a59c8-0a19-4fff-8793-aac389bd26ce None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:16.490131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a59c8-0a19-4fff-8793-aac389bd26ce None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:16.528161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e4bad-19de-4e9a-9031-fb37ddbd605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:16.528824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e4bad-19de-4e9a-9031-fb37ddbd605f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:16.529099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e4bad-19de-4e9a-9031-fb37ddbd605f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:16.529370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e4bad-19de-4e9a-9031-fb37ddbd605f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:16.530617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e4bad-19de-4e9a-9031-fb37ddbd605f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:16.532056 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e4bad-19de-4e9a-9031-fb37ddbd605f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:16.533665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 581/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:15:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:16.544226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b0ade-92ad-486b-b1bc-dd3bef7bdecc None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:16.664430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b0ade-92ad-486b-b1bc-dd3bef7bdecc None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:16.701702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6d500-17c0-49a1-8607-c806a0daaa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:16.702302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6d500-17c0-49a1-8607-c806a0daaa94 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:16.702574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6d500-17c0-49a1-8607-c806a0daaa94 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:16.702846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6d500-17c0-49a1-8607-c806a0daaa94 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:16.703496 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6d500-17c0-49a1-8607-c806a0daaa94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:16.704971 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6d500-17c0-49a1-8607-c806a0daaa94 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:16.733186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 557/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:15:16 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:15:18.924069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9cdd-306e-40eb-a4d0-cf430482a7c1 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:18.924701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9cdd-306e-40eb-a4d0-cf430482a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:18.924701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9cdd-306e-40eb-a4d0-cf430482a7c1 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:18.926011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 582/1139] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:15:18.932448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814452b0-9d0a-4012-9689-294b898803ea None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:18.933202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814452b0-9d0a-4012-9689-294b898803ea None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:18.933340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814452b0-9d0a-4012-9689-294b898803ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:18.954608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-814452b0-9d0a-4012-9689-294b898803ea None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:18.955816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-814452b0-9d0a-4012-9689-294b898803ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:18.981344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:19.029743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 558/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:19.311013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c9cdd-306e-40eb-a4d0-cf430482a7c1 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:19.340793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:19.434671 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c9cdd-306e-40eb-a4d0-cf430482a7c1 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:19.470201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e75e4-bb0f-4318-b01e-4ee524943d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:19.470818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e75e4-bb0f-4318-b01e-4ee524943d3e None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:19.471090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e75e4-bb0f-4318-b01e-4ee524943d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:19.471358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e75e4-bb0f-4318-b01e-4ee524943d3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:19.482241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e75e4-bb0f-4318-b01e-4ee524943d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-4b9e75e4-bb0f-4318-b01e-4ee524943d3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:15:19.486977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:15:19.488075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:15:19.489001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 583/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:15:19.494399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814452b0-9d0a-4012-9689-294b898803ea None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:19.596618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814452b0-9d0a-4012-9689-294b898803ea None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:19.631646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dd811-2642-4b9e-bd7d-e14d9ee5c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:19.632238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dd811-2642-4b9e-bd7d-e14d9ee5c93b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:19.632548 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dd811-2642-4b9e-bd7d-e14d9ee5c93b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:19.632818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dd811-2642-4b9e-bd7d-e14d9ee5c93b None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:19.633485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dd811-2642-4b9e-bd7d-e14d9ee5c93b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:19.633785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dd811-2642-4b9e-bd7d-e14d9ee5c93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:19.635155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dd811-2642-4b9e-bd7d-e14d9ee5c93b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:19.643461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 559/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:15:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:19.649722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e75e4-bb0f-4318-b01e-4ee524943d3e None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:19.735750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:19.758093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e75e4-bb0f-4318-b01e-4ee524943d3e None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:19.794258 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c51e9-de30-4b18-b5cd-224af9c35e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:19.795063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c51e9-de30-4b18-b5cd-224af9c35e75 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:19.795342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c51e9-de30-4b18-b5cd-224af9c35e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:19.795615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c51e9-de30-4b18-b5cd-224af9c35e75 None admin] PATH_INFO: `/v3/users/d5687a9c4fc04f46a975a88b1b7cea34` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:19.809388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c51e9-de30-4b18-b5cd-224af9c35e75 None admin] RBAC: Authorizing `identity:get_user(user_id=d5687a9c4fc04f46a975a88b1b7cea34)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:19.811170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c51e9-de30-4b18-b5cd-224af9c35e75 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:19.812825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 584/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:19 2022] GET /identity/v3/users/d5687a9c4fc04f46a975a88b1b7cea34 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:19.819321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dd811-2642-4b9e-bd7d-e14d9ee5c93b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:19.843575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:19.926837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dd811-2642-4b9e-bd7d-e14d9ee5c93b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:19.965127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab43226-65c5-41ca-a700-af6ab135817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:19.965715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab43226-65c5-41ca-a700-af6ab135817d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:19.965976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab43226-65c5-41ca-a700-af6ab135817d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:19.966420 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab43226-65c5-41ca-a700-af6ab135817d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:20.045245 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab43226-65c5-41ca-a700-af6ab135817d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:20.046695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab43226-65c5-41ca-a700-af6ab135817d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:20.067209 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:20.159836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 560/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:15:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:15:20.166596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c51e9-de30-4b18-b5cd-224af9c35e75 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:20.275834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c51e9-de30-4b18-b5cd-224af9c35e75 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:20.313571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c0630-2d90-44d7-8f3b-cb492a47b907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:20.314195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c0630-2d90-44d7-8f3b-cb492a47b907 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:20.314476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c0630-2d90-44d7-8f3b-cb492a47b907 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:20.315091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c0630-2d90-44d7-8f3b-cb492a47b907 None admin] PATH_INFO: `/v3/projects/ddc5730df5df464ebd830ebe2947d2a2` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:20.316289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c0630-2d90-44d7-8f3b-cb492a47b907 None admin] RBAC: Authorizing `identity:get_project(project_id=ddc5730df5df464ebd830ebe2947d2a2)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:20.317773 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c0630-2d90-44d7-8f3b-cb492a47b907 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:20.319446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 585/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:15:20 2022] GET /identity/v3/projects/ddc5730df5df464ebd830ebe2947d2a2 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:20.328731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab43226-65c5-41ca-a700-af6ab135817d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:20.432237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab43226-65c5-41ca-a700-af6ab135817d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:20.452695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:20.468517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f2980-b281-45e4-acea-6dd70350187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:20.469114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2980-b281-45e4-acea-6dd70350187c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:20.469385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2980-b281-45e4-acea-6dd70350187c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:20.469654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2980-b281-45e4-acea-6dd70350187c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:20.470353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f2980-b281-45e4-acea-6dd70350187c None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=ddc5730df5df464ebd830ebe2947d2a2, user.id=d5687a9c4fc04f46a975a88b1b7cea34) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:20.470653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f2980-b281-45e4-acea-6dd70350187c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:20.472076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f2980-b281-45e4-acea-6dd70350187c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:20.477594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 561/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:15:20 2022] GET /identity/v3/role_assignments?user.id=d5687a9c4fc04f46a975a88b1b7cea34&scope.project.id=ddc5730df5df464ebd830ebe2947d2a2&role.id=71bed99a52684ba990097719b40ef99d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:22.620229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c77cde-dc75-4171-a073-7e8e8cd0cc08 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:22.620875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c77cde-dc75-4171-a073-7e8e8cd0cc08 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:22.620875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c77cde-dc75-4171-a073-7e8e8cd0cc08 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:22.623894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 586/1147] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:22.632859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47887b5a-21a7-4ef5-8d0d-0ff2a305876d None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:22.633289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47887b5a-21a7-4ef5-8d0d-0ff2a305876d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:22.633429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47887b5a-21a7-4ef5-8d0d-0ff2a305876d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:22.661239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-47887b5a-21a7-4ef5-8d0d-0ff2a305876d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:22.662445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-47887b5a-21a7-4ef5-8d0d-0ff2a305876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:22.741273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 562/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:23.011718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c77cde-dc75-4171-a073-7e8e8cd0cc08 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:23.022688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:23.129482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c77cde-dc75-4171-a073-7e8e8cd0cc08 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:23.164507 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d455750-8234-4969-9542-ef724c4df2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:23.165130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d455750-8234-4969-9542-ef724c4df2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:23.165403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d455750-8234-4969-9542-ef724c4df2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:23.165675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d455750-8234-4969-9542-ef724c4df2a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:23.176988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d455750-8234-4969-9542-ef724c4df2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-4d455750-8234-4969-9542-ef724c4df2a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:15:23.181778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:15:23.182925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:15:23.183976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 587/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:15:23.190079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47887b5a-21a7-4ef5-8d0d-0ff2a305876d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:23.292818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47887b5a-21a7-4ef5-8d0d-0ff2a305876d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:23.307015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:23.331013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1ef2b-1739-4051-9416-67c13cfbc144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:23.331620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1ef2b-1739-4051-9416-67c13cfbc144 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:23.331896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1ef2b-1739-4051-9416-67c13cfbc144 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:23.332169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1ef2b-1739-4051-9416-67c13cfbc144 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:23.332883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1ef2b-1739-4051-9416-67c13cfbc144 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:23.333186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1ef2b-1739-4051-9416-67c13cfbc144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:23.334553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1ef2b-1739-4051-9416-67c13cfbc144 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:23.343432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 563/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:23.349476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d455750-8234-4969-9542-ef724c4df2a6 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:23.422165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:23.463548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d455750-8234-4969-9542-ef724c4df2a6 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:23.500945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332e611-8f55-4bda-94ef-1c0d59cee3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:23.501564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332e611-8f55-4bda-94ef-1c0d59cee3ff None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:23.501837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332e611-8f55-4bda-94ef-1c0d59cee3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:23.502109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332e611-8f55-4bda-94ef-1c0d59cee3ff None admin] PATH_INFO: `/v3/users/d5687a9c4fc04f46a975a88b1b7cea34` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:23.503265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332e611-8f55-4bda-94ef-1c0d59cee3ff None admin] RBAC: Authorizing `identity:get_user(user_id=d5687a9c4fc04f46a975a88b1b7cea34)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:23.504729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332e611-8f55-4bda-94ef-1c0d59cee3ff None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:23.506305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 588/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:23 2022] GET /identity/v3/users/d5687a9c4fc04f46a975a88b1b7cea34 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:23.514795 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1ef2b-1739-4051-9416-67c13cfbc144 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:23.618204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1ef2b-1739-4051-9416-67c13cfbc144 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:23.652072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec4951-94b4-4e26-a5cc-7541572f5252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:23.652713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec4951-94b4-4e26-a5cc-7541572f5252 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:23.652970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec4951-94b4-4e26-a5cc-7541572f5252 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:23.653270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec4951-94b4-4e26-a5cc-7541572f5252 None admin] PATH_INFO: `/v3/projects/ddc5730df5df464ebd830ebe2947d2a2` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:23.654565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec4951-94b4-4e26-a5cc-7541572f5252 None admin] RBAC: Authorizing `identity:get_project(project_id=ddc5730df5df464ebd830ebe2947d2a2)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:23.655989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec4951-94b4-4e26-a5cc-7541572f5252 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:23.657620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 564/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:15:23 2022] GET /identity/v3/projects/ddc5730df5df464ebd830ebe2947d2a2 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:15:23.667050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332e611-8f55-4bda-94ef-1c0d59cee3ff None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:23.774509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332e611-8f55-4bda-94ef-1c0d59cee3ff None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:23.811326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47456b2e-0ee6-4c7f-9bb0-2b6aff50a869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:23.811983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47456b2e-0ee6-4c7f-9bb0-2b6aff50a869 None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:23.812260 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47456b2e-0ee6-4c7f-9bb0-2b6aff50a869 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:23.812562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47456b2e-0ee6-4c7f-9bb0-2b6aff50a869 None admin] PATH_INFO: `/v3/projects/ddc5730df5df464ebd830ebe2947d2a2/users/d5687a9c4fc04f46a975a88b1b7cea34/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:23.814851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47456b2e-0ee6-4c7f-9bb0-2b6aff50a869 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddc5730df5df464ebd830ebe2947d2a2, user_id=d5687a9c4fc04f46a975a88b1b7cea34, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:23.816293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47456b2e-0ee6-4c7f-9bb0-2b6aff50a869 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:23.818687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:23.833487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 589/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:15:23 2022] PUT /identity/v3/projects/ddc5730df5df464ebd830ebe2947d2a2/users/d5687a9c4fc04f46a975a88b1b7cea34/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:15:25.957355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fae60-057a-4879-b49e-b8cc808e0ded None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:25.957928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fae60-057a-4879-b49e-b8cc808e0ded None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:25.957928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fae60-057a-4879-b49e-b8cc808e0ded None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:25.959268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 565/1154] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:25.965688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac439e3-c032-4c29-b86d-f69566b63448 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:25.966170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac439e3-c032-4c29-b86d-f69566b63448 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:25.966284 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac439e3-c032-4c29-b86d-f69566b63448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:25.991198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6ac439e3-c032-4c29-b86d-f69566b63448 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:25.992375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6ac439e3-c032-4c29-b86d-f69566b63448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:26.063042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 590/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:26.328066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fae60-057a-4879-b49e-b8cc808e0ded None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:26.383002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:26.441395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fae60-057a-4879-b49e-b8cc808e0ded None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:26.478065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76191255-e495-46d3-b1da-85560e47d3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:26.478688 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76191255-e495-46d3-b1da-85560e47d3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:26.478966 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76191255-e495-46d3-b1da-85560e47d3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:26.479237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76191255-e495-46d3-b1da-85560e47d3e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:26.491383 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76191255-e495-46d3-b1da-85560e47d3e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-76191255-e495-46d3-b1da-85560e47d3e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:15:26.496176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:15:26.497569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:15:26.498801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 566/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:15:26.505659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac439e3-c032-4c29-b86d-f69566b63448 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:26.618192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac439e3-c032-4c29-b86d-f69566b63448 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:26.642017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:26.655482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfd3b2-9c56-4c6a-a404-7343cc7d30fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:26.656080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd3b2-9c56-4c6a-a404-7343cc7d30fe None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:26.656354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd3b2-9c56-4c6a-a404-7343cc7d30fe None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:26.656649 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd3b2-9c56-4c6a-a404-7343cc7d30fe None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:26.657304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfd3b2-9c56-4c6a-a404-7343cc7d30fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:26.657602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfd3b2-9c56-4c6a-a404-7343cc7d30fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:26.658964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfd3b2-9c56-4c6a-a404-7343cc7d30fe None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:26.670513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 591/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:26.677363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76191255-e495-46d3-b1da-85560e47d3e6 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:26.798846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76191255-e495-46d3-b1da-85560e47d3e6 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:26.801281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:26.834869 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9798e-15db-4103-bf75-95c48e95146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:26.835499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9798e-15db-4103-bf75-95c48e95146a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:26.835776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9798e-15db-4103-bf75-95c48e95146a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:26.836052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9798e-15db-4103-bf75-95c48e95146a None admin] PATH_INFO: `/v3/users/d5687a9c4fc04f46a975a88b1b7cea34` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:26.837323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9798e-15db-4103-bf75-95c48e95146a None admin] RBAC: Authorizing `identity:get_user(user_id=d5687a9c4fc04f46a975a88b1b7cea34)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:26.838761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9798e-15db-4103-bf75-95c48e95146a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:26.840339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 567/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:26 2022] GET /identity/v3/users/d5687a9c4fc04f46a975a88b1b7cea34 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:26.846831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfd3b2-9c56-4c6a-a404-7343cc7d30fe None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:26.948492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfd3b2-9c56-4c6a-a404-7343cc7d30fe None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:26.983980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d849c8-1e59-4e56-b5e4-57b0df84cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:26.984642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d849c8-1e59-4e56-b5e4-57b0df84cc73 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:26.984869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d849c8-1e59-4e56-b5e4-57b0df84cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:26.985143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d849c8-1e59-4e56-b5e4-57b0df84cc73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:27.040211 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:27.061732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d849c8-1e59-4e56-b5e4-57b0df84cc73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:27.063186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d849c8-1e59-4e56-b5e4-57b0df84cc73 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:27.166633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 592/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:15:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:15:27.175777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9798e-15db-4103-bf75-95c48e95146a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:27.284271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9798e-15db-4103-bf75-95c48e95146a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:27.318937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d8ca6-762f-4a26-b93a-e835f0936f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:27.319546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d8ca6-762f-4a26-b93a-e835f0936f68 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:27.319815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d8ca6-762f-4a26-b93a-e835f0936f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:27.320076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d8ca6-762f-4a26-b93a-e835f0936f68 None admin] PATH_INFO: `/v3/projects/ddc5730df5df464ebd830ebe2947d2a2` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:27.321210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d8ca6-762f-4a26-b93a-e835f0936f68 None admin] RBAC: Authorizing `identity:get_project(project_id=ddc5730df5df464ebd830ebe2947d2a2)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:27.322635 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d8ca6-762f-4a26-b93a-e835f0936f68 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:27.324255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 568/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:15:27 2022] GET /identity/v3/projects/ddc5730df5df464ebd830ebe2947d2a2 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:27.330695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d849c8-1e59-4e56-b5e4-57b0df84cc73 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:27.423670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:27.441386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d849c8-1e59-4e56-b5e4-57b0df84cc73 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:27.477571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a4b85-bd22-482b-9871-0f83ee1c673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:27.478164 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a4b85-bd22-482b-9871-0f83ee1c673f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:27.478440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a4b85-bd22-482b-9871-0f83ee1c673f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:27.478714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a4b85-bd22-482b-9871-0f83ee1c673f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:27.479432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a4b85-bd22-482b-9871-0f83ee1c673f None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=ddc5730df5df464ebd830ebe2947d2a2, user.id=d5687a9c4fc04f46a975a88b1b7cea34) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:27.479744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a4b85-bd22-482b-9871-0f83ee1c673f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:27.481692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a4b85-bd22-482b-9871-0f83ee1c673f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:27.490973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 593/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:15:27 2022] GET /identity/v3/role_assignments?user.id=d5687a9c4fc04f46a975a88b1b7cea34&scope.project.id=ddc5730df5df464ebd830ebe2947d2a2&role.id=71bed99a52684ba990097719b40ef99d => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:29.631557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83eeb6-7bcd-43b1-a93f-aa31df422095 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:29.632529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83eeb6-7bcd-43b1-a93f-aa31df422095 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:29.632529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83eeb6-7bcd-43b1-a93f-aa31df422095 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:29.634624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 569/1162] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:29.641004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d13c0-cafc-47b5-b896-8158c52f8ff4 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:29.641457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d13c0-cafc-47b5-b896-8158c52f8ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:29.641550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d13c0-cafc-47b5-b896-8158c52f8ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:29.669947 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-b44d13c0-cafc-47b5-b896-8158c52f8ff4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:29.671162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b44d13c0-cafc-47b5-b896-8158c52f8ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:29.740157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 594/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:30.022547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83eeb6-7bcd-43b1-a93f-aa31df422095 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:30.087397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:30.161017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83eeb6-7bcd-43b1-a93f-aa31df422095 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:30.204278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1222e11-6d7a-4f72-b44a-7f7d3266c68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:30.205183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1222e11-6d7a-4f72-b44a-7f7d3266c68c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:30.205585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1222e11-6d7a-4f72-b44a-7f7d3266c68c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:30.205976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1222e11-6d7a-4f72-b44a-7f7d3266c68c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:30.282597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1222e11-6d7a-4f72-b44a-7f7d3266c68c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:30.283983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1222e11-6d7a-4f72-b44a-7f7d3266c68c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:30.325907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:30.386820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 570/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:15:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:15:30.393901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d13c0-cafc-47b5-b896-8158c52f8ff4 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:30.486587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:30.512418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d13c0-cafc-47b5-b896-8158c52f8ff4 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:30.547532 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e77add-304c-4cef-8e97-3520503580a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:30.548079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e77add-304c-4cef-8e97-3520503580a2 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:30.548350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e77add-304c-4cef-8e97-3520503580a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:30.548648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e77add-304c-4cef-8e97-3520503580a2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:30.555168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e77add-304c-4cef-8e97-3520503580a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:30.556643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e77add-304c-4cef-8e97-3520503580a2 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-24e77add-304c-4cef-8e97-3520503580a2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:15:30.568744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:15:30.569903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:15:30.570775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 595/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Sep 16 19:15:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:15:30.578058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1222e11-6d7a-4f72-b44a-7f7d3266c68c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:30.692151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1222e11-6d7a-4f72-b44a-7f7d3266c68c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:30.727200 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2798709-35e0-4e3c-89d2-d110e2613942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:30.727807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2798709-35e0-4e3c-89d2-d110e2613942 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:30.728084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2798709-35e0-4e3c-89d2-d110e2613942 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:30.728352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2798709-35e0-4e3c-89d2-d110e2613942 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:30.729027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2798709-35e0-4e3c-89d2-d110e2613942 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:30.729331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2798709-35e0-4e3c-89d2-d110e2613942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:30.730698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2798709-35e0-4e3c-89d2-d110e2613942 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:30.738860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 571/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Sep 16 19:15:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:32.898995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e06c21-8fa5-44b3-b970-babb6c9d10a7 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:32.899883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e06c21-8fa5-44b3-b970-babb6c9d10a7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:32.899883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e06c21-8fa5-44b3-b970-babb6c9d10a7 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:32.902077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 596/1167] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:32.907621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2155926-7ed9-42b6-8a31-d61c7b6d8080 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:32.908072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2155926-7ed9-42b6-8a31-d61c7b6d8080 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:32.908175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2155926-7ed9-42b6-8a31-d61c7b6d8080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:32.916453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:32.928417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e2155926-7ed9-42b6-8a31-d61c7b6d8080 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:32.929604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e2155926-7ed9-42b6-8a31-d61c7b6d8080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:32.998136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 572/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:33.263615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e06c21-8fa5-44b3-b970-babb6c9d10a7 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:33.379598 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e06c21-8fa5-44b3-b970-babb6c9d10a7 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:33.417741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13556159-e269-41e1-8529-de7b22f4144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:33.418426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13556159-e269-41e1-8529-de7b22f4144c None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:33.418792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13556159-e269-41e1-8529-de7b22f4144c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:33.419067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13556159-e269-41e1-8529-de7b22f4144c None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:33.419726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13556159-e269-41e1-8529-de7b22f4144c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:33.421125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13556159-e269-41e1-8529-de7b22f4144c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:33.435180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:33.444447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 597/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Fri Sep 16 19:15:33 2022] POST /identity/v3/domains => generated 267 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:15:35.712552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ec82f-cb79-4b32-9717-b8df692493b2 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:35.713131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ec82f-cb79-4b32-9717-b8df692493b2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:35.713131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ec82f-cb79-4b32-9717-b8df692493b2 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:35.715109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 573/1170] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:35.723996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6be7-eb35-4afc-9a6e-978827af0b70 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:35.724422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6be7-eb35-4afc-9a6e-978827af0b70 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:35.724635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6be7-eb35-4afc-9a6e-978827af0b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:35.749484 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-c12a6be7-eb35-4afc-9a6e-978827af0b70 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:35.751250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c12a6be7-eb35-4afc-9a6e-978827af0b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:35.827772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 598/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:36.095332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ec82f-cb79-4b32-9717-b8df692493b2 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:36.202898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ec82f-cb79-4b32-9717-b8df692493b2 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:36.239029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b992f71-7297-428f-a2ac-300272202b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:36.239649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b992f71-7297-428f-a2ac-300272202b3c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:36.239926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b992f71-7297-428f-a2ac-300272202b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:36.240203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b992f71-7297-428f-a2ac-300272202b3c None admin] PATH_INFO: `/v3/domains/f69a18da93c24ee793c3cc9b15c235d7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:36.242443 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:36.255381 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b992f71-7297-428f-a2ac-300272202b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=f69a18da93c24ee793c3cc9b15c235d7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:36.257773 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b992f71-7297-428f-a2ac-300272202b3c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:36.260269 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 574/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Fri Sep 16 19:15:36 2022] GET /identity/v3/domains/f69a18da93c24ee793c3cc9b15c235d7 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:36.266497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a6be7-eb35-4afc-9a6e-978827af0b70 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:36.367850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a6be7-eb35-4afc-9a6e-978827af0b70 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:36.397938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:36.408154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2212a-bdf3-46c9-84eb-cf71b69622c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:36.409141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2212a-bdf3-46c9-84eb-cf71b69622c2 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:36.409550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2212a-bdf3-46c9-84eb-cf71b69622c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:36.409962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2212a-bdf3-46c9-84eb-cf71b69622c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:36.410990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2212a-bdf3-46c9-84eb-cf71b69622c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:36.413388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2212a-bdf3-46c9-84eb-cf71b69622c2 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:36.444541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 599/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:15:36 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:15:38.621717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05a44e-63aa-4ce5-844b-804239a258bf None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:38.622577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05a44e-63aa-4ce5-844b-804239a258bf None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:38.622577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05a44e-63aa-4ce5-844b-804239a258bf None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:38.624540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 575/1174] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:38.633365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7dc6d-b540-4d9a-91a9-370b3fc6af07 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:38.633784 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7dc6d-b540-4d9a-91a9-370b3fc6af07 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:38.633972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7dc6d-b540-4d9a-91a9-370b3fc6af07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:38.656060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f3a7dc6d-b540-4d9a-91a9-370b3fc6af07 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:38.657290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f3a7dc6d-b540-4d9a-91a9-370b3fc6af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:38.732075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 600/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:39.014174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05a44e-63aa-4ce5-844b-804239a258bf None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:39.131966 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05a44e-63aa-4ce5-844b-804239a258bf None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:39.165601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd631a-f9e9-4e09-8bea-d1c2a0a64793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:39.166228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd631a-f9e9-4e09-8bea-d1c2a0a64793 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:39.166506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd631a-f9e9-4e09-8bea-d1c2a0a64793 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:39.166776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd631a-f9e9-4e09-8bea-d1c2a0a64793 None admin] PATH_INFO: `/v3/domains/f69a18da93c24ee793c3cc9b15c235d7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:39.167945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd631a-f9e9-4e09-8bea-d1c2a0a64793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f69a18da93c24ee793c3cc9b15c235d7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:39.169584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd631a-f9e9-4e09-8bea-d1c2a0a64793 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:39.171176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 576/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Fri Sep 16 19:15:39 2022] GET /identity/v3/domains/f69a18da93c24ee793c3cc9b15c235d7 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:39.177520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7dc6d-b540-4d9a-91a9-370b3fc6af07 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:39.293335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7dc6d-b540-4d9a-91a9-370b3fc6af07 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:39.306325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:39.330817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822599d-ed7b-4bd5-b8fb-ef9b130fb78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:39.331421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822599d-ed7b-4bd5-b8fb-ef9b130fb78b None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:39.331694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822599d-ed7b-4bd5-b8fb-ef9b130fb78b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:39.331961 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822599d-ed7b-4bd5-b8fb-ef9b130fb78b None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:39.332643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822599d-ed7b-4bd5-b8fb-ef9b130fb78b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:39.334069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822599d-ed7b-4bd5-b8fb-ef9b130fb78b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:39.357182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 601/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:15:39 2022] POST /identity/v3/users => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:15:41.546639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3dd9-2c27-43fa-9542-bac1432618f2 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:41.547510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3dd9-2c27-43fa-9542-bac1432618f2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:41.547510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3dd9-2c27-43fa-9542-bac1432618f2 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:41.549732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 577/1178] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:41.558639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc6144-a875-45f9-bce1-d3be2a5b57e0 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:41.559083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc6144-a875-45f9-bce1-d3be2a5b57e0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:41.559188 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc6144-a875-45f9-bce1-d3be2a5b57e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:41.579978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4bbc6144-a875-45f9-bce1-d3be2a5b57e0 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:41.581198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4bbc6144-a875-45f9-bce1-d3be2a5b57e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:41.663585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 602/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:41.932371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f3dd9-2c27-43fa-9542-bac1432618f2 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:42.010827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:42.053067 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f3dd9-2c27-43fa-9542-bac1432618f2 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:42.096326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5806e-b20b-4165-b1c3-53a86f59d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:42.096984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5806e-b20b-4165-b1c3-53a86f59d185 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:42.097258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5806e-b20b-4165-b1c3-53a86f59d185 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:42.097527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5806e-b20b-4165-b1c3-53a86f59d185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:42.109959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5806e-b20b-4165-b1c3-53a86f59d185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-fac5806e-b20b-4165-b1c3-53a86f59d185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:15:42.114681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:15:42.115737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:15:42.116710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 578/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:15:42.122824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc6144-a875-45f9-bce1-d3be2a5b57e0 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:42.230945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:42.235246 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc6144-a875-45f9-bce1-d3be2a5b57e0 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:42.269898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee979cf-0c28-45df-8434-41d928f0ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:42.270497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee979cf-0c28-45df-8434-41d928f0ea4a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:42.270773 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee979cf-0c28-45df-8434-41d928f0ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:42.271048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee979cf-0c28-45df-8434-41d928f0ea4a None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:42.271712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee979cf-0c28-45df-8434-41d928f0ea4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:42.272015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee979cf-0c28-45df-8434-41d928f0ea4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:42.273430 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee979cf-0c28-45df-8434-41d928f0ea4a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:42.281404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 603/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:15:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:42.287584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5806e-b20b-4165-b1c3-53a86f59d185 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:42.400444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5806e-b20b-4165-b1c3-53a86f59d185 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:42.423864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:42.437558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050824c8-39c5-44b8-8551-d3c2c35c0e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:42.438185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050824c8-39c5-44b8-8551-d3c2c35c0e38 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:42.438814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050824c8-39c5-44b8-8551-d3c2c35c0e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:42.439088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050824c8-39c5-44b8-8551-d3c2c35c0e38 None admin] PATH_INFO: `/v3/users/4b8d326ee5ab46b58d61ce74b836bcc7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:42.453004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050824c8-39c5-44b8-8551-d3c2c35c0e38 None admin] RBAC: Authorizing `identity:get_user(user_id=4b8d326ee5ab46b58d61ce74b836bcc7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:42.454441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050824c8-39c5-44b8-8551-d3c2c35c0e38 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:42.456041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 579/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:42 2022] GET /identity/v3/users/4b8d326ee5ab46b58d61ce74b836bcc7 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:42.462108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee979cf-0c28-45df-8434-41d928f0ea4a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:42.584077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee979cf-0c28-45df-8434-41d928f0ea4a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:42.620116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a89e0-213b-4396-8875-1e3d25495a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:42.620750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a89e0-213b-4396-8875-1e3d25495a96 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:42.620998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a89e0-213b-4396-8875-1e3d25495a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:42.621293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a89e0-213b-4396-8875-1e3d25495a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:42.648955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:42.690053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a89e0-213b-4396-8875-1e3d25495a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:42.691501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a89e0-213b-4396-8875-1e3d25495a96 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:42.798338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 604/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:15:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:15:42.806931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050824c8-39c5-44b8-8551-d3c2c35c0e38 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:42.905645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050824c8-39c5-44b8-8551-d3c2c35c0e38 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:42.940514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccada4a8-d19b-4577-ab2e-2f1571ba82b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:42.941132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada4a8-d19b-4577-ab2e-2f1571ba82b5 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:42.941407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada4a8-d19b-4577-ab2e-2f1571ba82b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:42.941671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada4a8-d19b-4577-ab2e-2f1571ba82b5 None admin] PATH_INFO: `/v3/projects/4d77b25e71d24c84bd117517a1198c55` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:42.942831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccada4a8-d19b-4577-ab2e-2f1571ba82b5 None admin] RBAC: Authorizing `identity:get_project(project_id=4d77b25e71d24c84bd117517a1198c55)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:42.944254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccada4a8-d19b-4577-ab2e-2f1571ba82b5 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:42.945911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 580/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:15:42 2022] GET /identity/v3/projects/4d77b25e71d24c84bd117517a1198c55 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:42.952401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a89e0-213b-4396-8875-1e3d25495a96 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:43.013039 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:43.055243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a89e0-213b-4396-8875-1e3d25495a96 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:43.093842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dbc93-9246-47d4-ab94-acc72b0791db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:43.094429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dbc93-9246-47d4-ab94-acc72b0791db None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:43.094698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dbc93-9246-47d4-ab94-acc72b0791db None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:43.094967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dbc93-9246-47d4-ab94-acc72b0791db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:43.095680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dbc93-9246-47d4-ab94-acc72b0791db None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=4d77b25e71d24c84bd117517a1198c55, user.id=4b8d326ee5ab46b58d61ce74b836bcc7) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:43.095980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dbc93-9246-47d4-ab94-acc72b0791db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:43.097431 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dbc93-9246-47d4-ab94-acc72b0791db None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:43.102860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 605/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:15:42 2022] GET /identity/v3/role_assignments?user.id=4b8d326ee5ab46b58d61ce74b836bcc7&scope.project.id=4d77b25e71d24c84bd117517a1198c55&role.id=71bed99a52684ba990097719b40ef99d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:45.254970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e47e8-9638-4fe2-8f20-f8abf2120c13 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:45.255500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e47e8-9638-4fe2-8f20-f8abf2120c13 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:45.255500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e47e8-9638-4fe2-8f20-f8abf2120c13 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:45.256797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 581/1186] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:45.263054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714441a-7a6e-47d4-becb-119d82bac9f6 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:45.263724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714441a-7a6e-47d4-becb-119d82bac9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:45.263876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714441a-7a6e-47d4-becb-119d82bac9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:45.288276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8714441a-7a6e-47d4-becb-119d82bac9f6 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:45.289522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8714441a-7a6e-47d4-becb-119d82bac9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:45.364207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 606/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:45.635098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e47e8-9638-4fe2-8f20-f8abf2120c13 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:45.692063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:45.746892 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e47e8-9638-4fe2-8f20-f8abf2120c13 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:45.785028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502f320-4e4c-44a3-9449-0b62855ced91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:45.785664 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502f320-4e4c-44a3-9449-0b62855ced91 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:45.785944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502f320-4e4c-44a3-9449-0b62855ced91 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:45.786211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502f320-4e4c-44a3-9449-0b62855ced91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:45.797284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502f320-4e4c-44a3-9449-0b62855ced91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-6502f320-4e4c-44a3-9449-0b62855ced91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:15:45.802066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:15:45.803124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:15:45.804134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 582/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:15:45.810025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714441a-7a6e-47d4-becb-119d82bac9f6 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:45.876405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:45.934031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714441a-7a6e-47d4-becb-119d82bac9f6 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:45.973756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dda7e-fe23-4d7f-8eb0-441352eaec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:45.974345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dda7e-fe23-4d7f-8eb0-441352eaec15 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:45.974620 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dda7e-fe23-4d7f-8eb0-441352eaec15 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:45.974887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dda7e-fe23-4d7f-8eb0-441352eaec15 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:45.975551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dda7e-fe23-4d7f-8eb0-441352eaec15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:45.975850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dda7e-fe23-4d7f-8eb0-441352eaec15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:45.977264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dda7e-fe23-4d7f-8eb0-441352eaec15 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:45.985745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 607/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:15:45.992615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502f320-4e4c-44a3-9449-0b62855ced91 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:46.111472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502f320-4e4c-44a3-9449-0b62855ced91 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:46.120600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:46.152457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac03f68-d386-47c0-b3a7-54155a92434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:46.153103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac03f68-d386-47c0-b3a7-54155a92434e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:46.153381 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac03f68-d386-47c0-b3a7-54155a92434e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:46.153657 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac03f68-d386-47c0-b3a7-54155a92434e None admin] PATH_INFO: `/v3/users/4b8d326ee5ab46b58d61ce74b836bcc7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:46.154915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac03f68-d386-47c0-b3a7-54155a92434e None admin] RBAC: Authorizing `identity:get_user(user_id=4b8d326ee5ab46b58d61ce74b836bcc7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:46.156361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac03f68-d386-47c0-b3a7-54155a92434e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:46.158005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 583/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:45 2022] GET /identity/v3/users/4b8d326ee5ab46b58d61ce74b836bcc7 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:46.164606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dda7e-fe23-4d7f-8eb0-441352eaec15 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:46.272839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dda7e-fe23-4d7f-8eb0-441352eaec15 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:46.288987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:46.309542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f6a85-7478-4fec-aa2b-33cc417f8b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:46.310168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6a85-7478-4fec-aa2b-33cc417f8b83 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:46.310446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6a85-7478-4fec-aa2b-33cc417f8b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:46.310704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6a85-7478-4fec-aa2b-33cc417f8b83 None admin] PATH_INFO: `/v3/projects/4d77b25e71d24c84bd117517a1198c55` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:46.311949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f6a85-7478-4fec-aa2b-33cc417f8b83 None admin] RBAC: Authorizing `identity:get_project(project_id=4d77b25e71d24c84bd117517a1198c55)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:46.313769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f6a85-7478-4fec-aa2b-33cc417f8b83 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:46.315413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 608/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:15:46 2022] GET /identity/v3/projects/4d77b25e71d24c84bd117517a1198c55 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:46.322414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac03f68-d386-47c0-b3a7-54155a92434e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:46.428946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac03f68-d386-47c0-b3a7-54155a92434e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:46.466480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287f5ed-42eb-41d3-8756-38fe4d45f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:46.467119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f5ed-42eb-41d3-8756-38fe4d45f9c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:46.467389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f5ed-42eb-41d3-8756-38fe4d45f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:46.467652 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f5ed-42eb-41d3-8756-38fe4d45f9c3 None admin] PATH_INFO: `/v3/projects/4d77b25e71d24c84bd117517a1198c55/users/4b8d326ee5ab46b58d61ce74b836bcc7/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:46.469768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287f5ed-42eb-41d3-8756-38fe4d45f9c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d77b25e71d24c84bd117517a1198c55, user_id=4b8d326ee5ab46b58d61ce74b836bcc7, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:46.471278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287f5ed-42eb-41d3-8756-38fe4d45f9c3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:46.488873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 584/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:15:46 2022] PUT /identity/v3/projects/4d77b25e71d24c84bd117517a1198c55/users/4b8d326ee5ab46b58d61ce74b836bcc7/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:15:48.609109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd9bb3-0229-4017-85c5-c17cae95b885 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:48.609712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd9bb3-0229-4017-85c5-c17cae95b885 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:48.609712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd9bb3-0229-4017-85c5-c17cae95b885 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:48.611028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 609/1193] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:15:48.617614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8890dd-3639-40d6-a17d-e5b6086031ff None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:48.618298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8890dd-3639-40d6-a17d-e5b6086031ff None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:48.618460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8890dd-3639-40d6-a17d-e5b6086031ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:48.643990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ed8890dd-3639-40d6-a17d-e5b6086031ff None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:15:48.645198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ed8890dd-3639-40d6-a17d-e5b6086031ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:15:48.675457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:48.718226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 585/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:15:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:15:48.989760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd9bb3-0229-4017-85c5-c17cae95b885 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:49.096177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd9bb3-0229-4017-85c5-c17cae95b885 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:49.131932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f888f-191e-458a-9786-0fb689f2546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:49.132588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f888f-191e-458a-9786-0fb689f2546b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:49.132868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f888f-191e-458a-9786-0fb689f2546b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:49.133140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f888f-191e-458a-9786-0fb689f2546b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:49.144234 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f888f-191e-458a-9786-0fb689f2546b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-2f3f888f-191e-458a-9786-0fb689f2546b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:15:49.149087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:15:49.150146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:15:49.151570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 610/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:15:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:15:49.159114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8890dd-3639-40d6-a17d-e5b6086031ff None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:49.274681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8890dd-3639-40d6-a17d-e5b6086031ff None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:49.309932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26050309-ac35-42be-aa33-17c454987595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:49.310527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26050309-ac35-42be-aa33-17c454987595 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:49.310799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26050309-ac35-42be-aa33-17c454987595 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:49.311061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26050309-ac35-42be-aa33-17c454987595 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:49.311715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26050309-ac35-42be-aa33-17c454987595 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:49.312016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26050309-ac35-42be-aa33-17c454987595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:49.313769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26050309-ac35-42be-aa33-17c454987595 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:49.321804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 586/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:49.328838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f888f-191e-458a-9786-0fb689f2546b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:49.387512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:49.447065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f888f-191e-458a-9786-0fb689f2546b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:49.482162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb649737-5fd1-4b90-9831-e49b1ec2154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:49.482780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb649737-5fd1-4b90-9831-e49b1ec2154d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:49.483058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb649737-5fd1-4b90-9831-e49b1ec2154d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:49.483329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb649737-5fd1-4b90-9831-e49b1ec2154d None admin] PATH_INFO: `/v3/users/4b8d326ee5ab46b58d61ce74b836bcc7` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:49.484629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb649737-5fd1-4b90-9831-e49b1ec2154d None admin] RBAC: Authorizing `identity:get_user(user_id=4b8d326ee5ab46b58d61ce74b836bcc7)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:49.486078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb649737-5fd1-4b90-9831-e49b1ec2154d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:49.487682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 611/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Sep 16 19:15:49 2022] GET /identity/v3/users/4b8d326ee5ab46b58d61ce74b836bcc7 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:49.493958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26050309-ac35-42be-aa33-17c454987595 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:49.527087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:49.610031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26050309-ac35-42be-aa33-17c454987595 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:49.648758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6775b-00a5-4841-a107-7a34489a233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:49.649379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6775b-00a5-4841-a107-7a34489a233e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:49.649588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6775b-00a5-4841-a107-7a34489a233e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:49.649878 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6775b-00a5-4841-a107-7a34489a233e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:49.715198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6775b-00a5-4841-a107-7a34489a233e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:49.716658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6775b-00a5-4841-a107-7a34489a233e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:49.744333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:49.827183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 587/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:15:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:15:49.836604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb649737-5fd1-4b90-9831-e49b1ec2154d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:49.943804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb649737-5fd1-4b90-9831-e49b1ec2154d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:49.957981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:49.981580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd22f03-142d-4681-9afb-23e29cbcde32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:49.982197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd22f03-142d-4681-9afb-23e29cbcde32 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:49.982473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd22f03-142d-4681-9afb-23e29cbcde32 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:49.982742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd22f03-142d-4681-9afb-23e29cbcde32 None admin] PATH_INFO: `/v3/projects/4d77b25e71d24c84bd117517a1198c55` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:49.983915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd22f03-142d-4681-9afb-23e29cbcde32 None admin] RBAC: Authorizing `identity:get_project(project_id=4d77b25e71d24c84bd117517a1198c55)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:49.985388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd22f03-142d-4681-9afb-23e29cbcde32 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:49.987009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 612/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Sep 16 19:15:49 2022] GET /identity/v3/projects/4d77b25e71d24c84bd117517a1198c55 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:15:49.993523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6775b-00a5-4841-a107-7a34489a233e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:15:50.104484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6775b-00a5-4841-a107-7a34489a233e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:15:50.134538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:50.143350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e604e-94a4-4cc6-a099-c0d35d6a0200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:15:50.143946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e604e-94a4-4cc6-a099-c0d35d6a0200 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:15:50.144221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e604e-94a4-4cc6-a099-c0d35d6a0200 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:15:50.144526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e604e-94a4-4cc6-a099-c0d35d6a0200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:15:50.145241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e604e-94a4-4cc6-a099-c0d35d6a0200 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=4d77b25e71d24c84bd117517a1198c55, user.id=4b8d326ee5ab46b58d61ce74b836bcc7) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:15:50.145544 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e604e-94a4-4cc6-a099-c0d35d6a0200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:15:50.146971 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e604e-94a4-4cc6-a099-c0d35d6a0200 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:15:50.153469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 588/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:15:49 2022] GET /identity/v3/role_assignments?user.id=4b8d326ee5ab46b58d61ce74b836bcc7&scope.project.id=4d77b25e71d24c84bd117517a1198c55&role.id=71bed99a52684ba990097719b40ef99d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:15:59.976311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=10 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:00.150757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:46.375023 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5142ea6-b330-4bae-a472-7574f1d0cacc None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:46.375678 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5142ea6-b330-4bae-a472-7574f1d0cacc None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:46.375678 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5142ea6-b330-4bae-a472-7574f1d0cacc None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:46.377178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 613/1201] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:16:46.382947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc25ef-1805-4b05-b2a0-e5df7e04fab3 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:46.383445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc25ef-1805-4b05-b2a0-e5df7e04fab3 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:46.383547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc25ef-1805-4b05-b2a0-e5df7e04fab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:46.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-75fc25ef-1805-4b05-b2a0-e5df7e04fab3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:46.404217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-75fc25ef-1805-4b05-b2a0-e5df7e04fab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:46.486510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 589/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:16:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:16:46.789759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5142ea6-b330-4bae-a472-7574f1d0cacc None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:46.917632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5142ea6-b330-4bae-a472-7574f1d0cacc None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:46.958178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f5e76-7ec7-4b74-97f4-c7241c3c3416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:46.958897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f5e76-7ec7-4b74-97f4-c7241c3c3416 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:46.959260 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f5e76-7ec7-4b74-97f4-c7241c3c3416 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:46.959637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f5e76-7ec7-4b74-97f4-c7241c3c3416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:46.971943 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f5e76-7ec7-4b74-97f4-c7241c3c3416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:46.973876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f5e76-7ec7-4b74-97f4-c7241c3c3416 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-8a7f5e76-7ec7-4b74-97f4-c7241c3c3416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:16:46.994774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:46.996060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:16:46.997081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:16:46.997081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:16:46.997081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:16:46.997081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 614/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:47.003210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc25ef-1805-4b05-b2a0-e5df7e04fab3 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:47.137354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc25ef-1805-4b05-b2a0-e5df7e04fab3 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:47.175148 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:47.181364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da79c1-509a-49c1-9b61-f8e56dc2566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:47.181988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da79c1-509a-49c1-9b61-f8e56dc2566c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:47.182268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da79c1-509a-49c1-9b61-f8e56dc2566c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:47.182536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da79c1-509a-49c1-9b61-f8e56dc2566c None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:47.183182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da79c1-509a-49c1-9b61-f8e56dc2566c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:47.183484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da79c1-509a-49c1-9b61-f8e56dc2566c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:47.185439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da79c1-509a-49c1-9b61-f8e56dc2566c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:47.204430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 590/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:47.206800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f5e76-7ec7-4b74-97f4-c7241c3c3416 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:47.277455 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:47.343129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f5e76-7ec7-4b74-97f4-c7241c3c3416 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:47.395494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad847a18-a298-42e8-bce3-566863627eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:47.396208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad847a18-a298-42e8-bce3-566863627eaa None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:47.396602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad847a18-a298-42e8-bce3-566863627eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:47.396950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad847a18-a298-42e8-bce3-566863627eaa None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:47.397924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad847a18-a298-42e8-bce3-566863627eaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:47.399965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad847a18-a298-42e8-bce3-566863627eaa None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:47.435061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 615/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Sep 16 19:16:47 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:16:49.823612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8239887-709a-40d4-a682-c12d417b6bb9 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:49.824170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8239887-709a-40d4-a682-c12d417b6bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:49.824170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8239887-709a-40d4-a682-c12d417b6bb9 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:49.825536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 591/1206] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:49.832654 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7af3db-314b-4c0a-b7f7-2a3fe96d3310 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:49.833181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7af3db-314b-4c0a-b7f7-2a3fe96d3310 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:49.833355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7af3db-314b-4c0a-b7f7-2a3fe96d3310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:49.854255 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5f7af3db-314b-4c0a-b7f7-2a3fe96d3310 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:49.855562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5f7af3db-314b-4c0a-b7f7-2a3fe96d3310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:49.935613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 616/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:16:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:16:50.207778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8239887-709a-40d4-a682-c12d417b6bb9 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:50.327840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8239887-709a-40d4-a682-c12d417b6bb9 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:50.369708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ba994-1fb4-4b26-b23c-a5f7f6a6417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:50.370424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba994-1fb4-4b26-b23c-a5f7f6a6417e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:50.370700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba994-1fb4-4b26-b23c-a5f7f6a6417e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:50.371029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba994-1fb4-4b26-b23c-a5f7f6a6417e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:50.383117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ba994-1fb4-4b26-b23c-a5f7f6a6417e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-4b5ba994-1fb4-4b26-b23c-a5f7f6a6417e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:16:50.387870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:50.389029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:16:50.390084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:16:50.394101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 592/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:16:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:50.395247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7af3db-314b-4c0a-b7f7-2a3fe96d3310 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:50.438847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:50.505226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7af3db-314b-4c0a-b7f7-2a3fe96d3310 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:50.545069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df08ab2-3490-4774-be30-e00d09ea77a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:50.545752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df08ab2-3490-4774-be30-e00d09ea77a8 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:50.546088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df08ab2-3490-4774-be30-e00d09ea77a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:50.546423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df08ab2-3490-4774-be30-e00d09ea77a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:50.547159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df08ab2-3490-4774-be30-e00d09ea77a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:50.547525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df08ab2-3490-4774-be30-e00d09ea77a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:50.548935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df08ab2-3490-4774-be30-e00d09ea77a8 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:50.557663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 617/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:16:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:50.564055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ba994-1fb4-4b26-b23c-a5f7f6a6417e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:50.619084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:50.676717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ba994-1fb4-4b26-b23c-a5f7f6a6417e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:50.714076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979e275-5bec-4598-93bb-fc0a821afd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:50.715042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979e275-5bec-4598-93bb-fc0a821afd2e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:50.715322 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979e275-5bec-4598-93bb-fc0a821afd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:50.715656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979e275-5bec-4598-93bb-fc0a821afd2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:50.731398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979e275-5bec-4598-93bb-fc0a821afd2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:50.733208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979e275-5bec-4598-93bb-fc0a821afd2e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-d979e275-5bec-4598-93bb-fc0a821afd2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:16:50.754387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:50.755668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:16:50.757106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:16:50.757106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:16:50.757106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:16:50.757106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 593/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:16:50.765276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df08ab2-3490-4774-be30-e00d09ea77a8 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:50.879914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:50.883462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df08ab2-3490-4774-be30-e00d09ea77a8 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:50.922626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccd9ba-f899-4c7c-b7ac-debac23c648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:50.923276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccd9ba-f899-4c7c-b7ac-debac23c648d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:50.923590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccd9ba-f899-4c7c-b7ac-debac23c648d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:50.923897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccd9ba-f899-4c7c-b7ac-debac23c648d None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:50.924674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccd9ba-f899-4c7c-b7ac-debac23c648d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:50.925014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccd9ba-f899-4c7c-b7ac-debac23c648d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:50.926557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccd9ba-f899-4c7c-b7ac-debac23c648d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:50.945564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 618/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:50.947675 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979e275-5bec-4598-93bb-fc0a821afd2e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:51.053589 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979e275-5bec-4598-93bb-fc0a821afd2e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:51.055636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:51.093773 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22d23f-8565-44e3-b93a-7bd88f0c3151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:51.094501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22d23f-8565-44e3-b93a-7bd88f0c3151 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:51.094839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22d23f-8565-44e3-b93a-7bd88f0c3151 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:51.095216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22d23f-8565-44e3-b93a-7bd88f0c3151 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:51.104153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22d23f-8565-44e3-b93a-7bd88f0c3151 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:51.105997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22d23f-8565-44e3-b93a-7bd88f0c3151 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-3e22d23f-8565-44e3-b93a-7bd88f0c3151 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:16:51.118840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:51.120073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:51.121457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:51.121457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:51.121457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:16:51.121457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:16:51.121457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:16:51.121457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:16:51.121457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:16:51.121457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:16:51.121457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:16:51.121457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:16:51.122348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 594/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:16:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:51.128182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccd9ba-f899-4c7c-b7ac-debac23c648d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:51.242184 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccd9ba-f899-4c7c-b7ac-debac23c648d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:51.277094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f079-1e82-440e-9b2d-483bb948f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:51.277702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f079-1e82-440e-9b2d-483bb948f82c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:51.277972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f079-1e82-440e-9b2d-483bb948f82c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:51.278239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f079-1e82-440e-9b2d-483bb948f82c None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:51.278987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551f079-1e82-440e-9b2d-483bb948f82c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:51.279286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551f079-1e82-440e-9b2d-483bb948f82c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:51.280742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551f079-1e82-440e-9b2d-483bb948f82c None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:51.298359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 619/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Sep 16 19:16:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:51.304542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22d23f-8565-44e3-b93a-7bd88f0c3151 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:51.412973 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22d23f-8565-44e3-b93a-7bd88f0c3151 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:51.455911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7db6-11e3-48bb-8315-1dc3c253e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:51.456584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7db6-11e3-48bb-8315-1dc3c253e1ba None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:51.456942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7db6-11e3-48bb-8315-1dc3c253e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:51.457250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7db6-11e3-48bb-8315-1dc3c253e1ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:51.490727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:51.539416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f7db6-11e3-48bb-8315-1dc3c253e1ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:51.541747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f7db6-11e3-48bb-8315-1dc3c253e1ba None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:51.664323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 595/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:16:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:16:51.670211 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f079-1e82-440e-9b2d-483bb948f82c None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:51.696116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:51.788129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f079-1e82-440e-9b2d-483bb948f82c None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:51.834805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bc2f0-500b-4cfe-9c28-481ea453e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:51.835528 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bc2f0-500b-4cfe-9c28-481ea453e698 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:51.835770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bc2f0-500b-4cfe-9c28-481ea453e698 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:51.836067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bc2f0-500b-4cfe-9c28-481ea453e698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:51.847461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bc2f0-500b-4cfe-9c28-481ea453e698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:51.848975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bc2f0-500b-4cfe-9c28-481ea453e698 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-823bc2f0-500b-4cfe-9c28-481ea453e698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:16:51.864616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:51.865756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:16:51.867321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:16:51.867321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:16:51.867321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:16:51.868594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 620/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:51.872741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7db6-11e3-48bb-8315-1dc3c253e1ba None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:51.952934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:51.998588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7db6-11e3-48bb-8315-1dc3c253e1ba None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:52.035583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135154e1-0826-403d-be5d-05180f5d7f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:52.036217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135154e1-0826-403d-be5d-05180f5d7f3c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:52.036540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135154e1-0826-403d-be5d-05180f5d7f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:52.036813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135154e1-0826-403d-be5d-05180f5d7f3c None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:52.037594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135154e1-0826-403d-be5d-05180f5d7f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:52.038044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135154e1-0826-403d-be5d-05180f5d7f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:52.039407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135154e1-0826-403d-be5d-05180f5d7f3c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:52.052099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 596/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:52.058286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bc2f0-500b-4cfe-9c28-481ea453e698 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:52.140533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:52.180448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bc2f0-500b-4cfe-9c28-481ea453e698 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:52.220531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b700bd-9260-43eb-852e-604e521257ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:52.221099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b700bd-9260-43eb-852e-604e521257ff None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:52.221380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b700bd-9260-43eb-852e-604e521257ff None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:52.221650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b700bd-9260-43eb-852e-604e521257ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:52.228755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b700bd-9260-43eb-852e-604e521257ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:52.230335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b700bd-9260-43eb-852e-604e521257ff None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-68b700bd-9260-43eb-852e-604e521257ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:16:52.243879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:52.245016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:52.246362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:16:52.246362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:16:52.246362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:16:52.246362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:16:52.246362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:16:52.246362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:16:52.246362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:16:52.246362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:16:52.246362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 621/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:52.251457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135154e1-0826-403d-be5d-05180f5d7f3c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:52.362162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135154e1-0826-403d-be5d-05180f5d7f3c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:52.387874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:52.402224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5381529-56e7-4baf-86f7-9d8f80005f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:52.402852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381529-56e7-4baf-86f7-9d8f80005f48 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:52.403129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381529-56e7-4baf-86f7-9d8f80005f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:52.403407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381529-56e7-4baf-86f7-9d8f80005f48 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:52.404108 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5381529-56e7-4baf-86f7-9d8f80005f48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:52.404458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5381529-56e7-4baf-86f7-9d8f80005f48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:52.405902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5381529-56e7-4baf-86f7-9d8f80005f48 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:52.422038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 597/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:52.428704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b700bd-9260-43eb-852e-604e521257ff None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:52.545513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b700bd-9260-43eb-852e-604e521257ff None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:52.577921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:52.584856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc123491-328c-4b47-acd9-61c932065093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:52.585511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc123491-328c-4b47-acd9-61c932065093 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:52.585825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc123491-328c-4b47-acd9-61c932065093 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:52.586131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc123491-328c-4b47-acd9-61c932065093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:52.586934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc123491-328c-4b47-acd9-61c932065093 None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=d09ca68fdd5b4e178bcd6a5c8bccc4f9) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:52.587267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc123491-328c-4b47-acd9-61c932065093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:52.588881 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc123491-328c-4b47-acd9-61c932065093 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:52.595358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 622/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:16:52 2022] GET /identity/v3/role_assignments?user.id=d09ca68fdd5b4e178bcd6a5c8bccc4f9&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:54.751189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0418-cb9a-4ff5-bd29-740ddf4fcb6e None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:54.751843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0418-cb9a-4ff5-bd29-740ddf4fcb6e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:54.751843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0418-cb9a-4ff5-bd29-740ddf4fcb6e None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:54.753306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 598/1220] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:54.760967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f204-369d-4841-9c8d-9752f9978f5c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:54.761458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f204-369d-4841-9c8d-9752f9978f5c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:54.761569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f204-369d-4841-9c8d-9752f9978f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:54.780351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-2723f204-369d-4841-9c8d-9752f9978f5c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:54.781575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2723f204-369d-4841-9c8d-9752f9978f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:54.852811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 623/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:16:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:16:55.133681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c0418-cb9a-4ff5-bd29-740ddf4fcb6e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:55.250794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c0418-cb9a-4ff5-bd29-740ddf4fcb6e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:55.291720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63e32-3070-497f-b071-bf6f8177347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:55.292371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63e32-3070-497f-b071-bf6f8177347d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:55.292686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63e32-3070-497f-b071-bf6f8177347d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:55.292955 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63e32-3070-497f-b071-bf6f8177347d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:55.304654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca63e32-3070-497f-b071-bf6f8177347d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-8ca63e32-3070-497f-b071-bf6f8177347d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:16:55.309868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:55.311015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:16:55.311980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 599/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:55.319623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f204-369d-4841-9c8d-9752f9978f5c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:55.418701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f204-369d-4841-9c8d-9752f9978f5c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:55.448350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:55.462588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658c05-46d5-4bbd-a991-4938ba6a22a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:55.463211 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658c05-46d5-4bbd-a991-4938ba6a22a4 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:55.463489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658c05-46d5-4bbd-a991-4938ba6a22a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:55.463760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658c05-46d5-4bbd-a991-4938ba6a22a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:55.464498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658c05-46d5-4bbd-a991-4938ba6a22a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:55.464806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658c05-46d5-4bbd-a991-4938ba6a22a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:55.466216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658c05-46d5-4bbd-a991-4938ba6a22a4 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:55.474598 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 624/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:55.480728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63e32-3070-497f-b071-bf6f8177347d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:55.530229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:55.594777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63e32-3070-497f-b071-bf6f8177347d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:55.637687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0cf41-8c36-47e0-a5af-ddefe3330463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:55.638326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0cf41-8c36-47e0-a5af-ddefe3330463 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:55.638599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0cf41-8c36-47e0-a5af-ddefe3330463 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:55.638866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0cf41-8c36-47e0-a5af-ddefe3330463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:55.650333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0cf41-8c36-47e0-a5af-ddefe3330463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:55.651797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0cf41-8c36-47e0-a5af-ddefe3330463 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-ddc0cf41-8c36-47e0-a5af-ddefe3330463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:16:55.671292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:55.672580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:16:55.673571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:16:55.673571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:16:55.673571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:16:55.673571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 600/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:55.679775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658c05-46d5-4bbd-a991-4938ba6a22a4 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:55.792541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658c05-46d5-4bbd-a991-4938ba6a22a4 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:55.828220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95787a-fc4a-4b80-a059-d9503a2b9aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:55.828823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95787a-fc4a-4b80-a059-d9503a2b9aef None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:55.829158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95787a-fc4a-4b80-a059-d9503a2b9aef None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:55.829432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95787a-fc4a-4b80-a059-d9503a2b9aef None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:55.830162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95787a-fc4a-4b80-a059-d9503a2b9aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:55.830476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95787a-fc4a-4b80-a059-d9503a2b9aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:55.832017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95787a-fc4a-4b80-a059-d9503a2b9aef None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:55.845625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 625/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:55.851742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0cf41-8c36-47e0-a5af-ddefe3330463 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:55.949474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:55.956724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0cf41-8c36-47e0-a5af-ddefe3330463 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:55.993378 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a3411-ea95-4c3e-82ec-5e5f3a9e7e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:55.994058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a3411-ea95-4c3e-82ec-5e5f3a9e7e33 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:55.994330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a3411-ea95-4c3e-82ec-5e5f3a9e7e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:55.994677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a3411-ea95-4c3e-82ec-5e5f3a9e7e33 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:56.003603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a3411-ea95-4c3e-82ec-5e5f3a9e7e33 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:56.005266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a3411-ea95-4c3e-82ec-5e5f3a9e7e33 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-1a6a3411-ea95-4c3e-82ec-5e5f3a9e7e33 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:16:56.021132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:56.022564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:16:56.023832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 601/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:16:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:56.029014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95787a-fc4a-4b80-a059-d9503a2b9aef None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:56.091591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:56.151481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95787a-fc4a-4b80-a059-d9503a2b9aef None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:56.191361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8b985-df85-4e41-863f-b1bc18fd41ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:56.192069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8b985-df85-4e41-863f-b1bc18fd41ac None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:56.192491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8b985-df85-4e41-863f-b1bc18fd41ac None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:56.192836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8b985-df85-4e41-863f-b1bc18fd41ac None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:56.193820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8b985-df85-4e41-863f-b1bc18fd41ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:56.194303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8b985-df85-4e41-863f-b1bc18fd41ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:56.195854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8b985-df85-4e41-863f-b1bc18fd41ac None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:56.218759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 626/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Sep 16 19:16:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:16:56.220396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a3411-ea95-4c3e-82ec-5e5f3a9e7e33 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:56.329183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a3411-ea95-4c3e-82ec-5e5f3a9e7e33 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:56.367799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269f38e-b29d-4e37-bbbc-ab1ae977ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:56.368484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269f38e-b29d-4e37-bbbc-ab1ae977ef89 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:56.368780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269f38e-b29d-4e37-bbbc-ab1ae977ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:56.369029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269f38e-b29d-4e37-bbbc-ab1ae977ef89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:56.379868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269f38e-b29d-4e37-bbbc-ab1ae977ef89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:56.382060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269f38e-b29d-4e37-bbbc-ab1ae977ef89 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-c269f38e-b29d-4e37-bbbc-ab1ae977ef89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:16:56.397305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:56.398481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:16:56.399556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:16:56.399556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:16:56.399556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:16:56.399556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 602/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:56.404416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8b985-df85-4e41-863f-b1bc18fd41ac None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:56.512078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8b985-df85-4e41-863f-b1bc18fd41ac None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:56.514428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:56.550283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcfbc7-3b3d-4c41-8853-54647265e609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:56.550557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcfbc7-3b3d-4c41-8853-54647265e609 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:56.550737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcfbc7-3b3d-4c41-8853-54647265e609 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:56.551047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcfbc7-3b3d-4c41-8853-54647265e609 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:56.551676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcfbc7-3b3d-4c41-8853-54647265e609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:56.551977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcfbc7-3b3d-4c41-8853-54647265e609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:56.553658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcfbc7-3b3d-4c41-8853-54647265e609 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:56.566396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 627/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:56.573846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269f38e-b29d-4e37-bbbc-ab1ae977ef89 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:56.585423 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:56.699846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269f38e-b29d-4e37-bbbc-ab1ae977ef89 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:56.737894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c7675-96b9-485e-8374-f3186eb0c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:56.738530 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7675-96b9-485e-8374-f3186eb0c639 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:56.738803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7675-96b9-485e-8374-f3186eb0c639 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:56.739073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7675-96b9-485e-8374-f3186eb0c639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:56.747358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c7675-96b9-485e-8374-f3186eb0c639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:56.749111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c7675-96b9-485e-8374-f3186eb0c639 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-226c7675-96b9-485e-8374-f3186eb0c639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:16:56.762266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:56.763236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:56.764155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:16:56.764155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:16:56.764155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:16:56.764155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:16:56.764155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:16:56.764155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:16:56.764155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:16:56.764155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:16:56.768550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 603/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:56.769688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcfbc7-3b3d-4c41-8853-54647265e609 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:56.888730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcfbc7-3b3d-4c41-8853-54647265e609 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:56.926265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78be9c-1713-454c-a6bd-5bfc0c09e1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:56.926880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78be9c-1713-454c-a6bd-5bfc0c09e1be None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:56.927157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78be9c-1713-454c-a6bd-5bfc0c09e1be None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:56.927426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78be9c-1713-454c-a6bd-5bfc0c09e1be None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:56.928752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78be9c-1713-454c-a6bd-5bfc0c09e1be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:16:56.929060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78be9c-1713-454c-a6bd-5bfc0c09e1be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:56.930505 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78be9c-1713-454c-a6bd-5bfc0c09e1be None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:56.942863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 628/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:56.949674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c7675-96b9-485e-8374-f3186eb0c639 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:57.020594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:57.059710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c7675-96b9-485e-8374-f3186eb0c639 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:57.096133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d41a2-c8ac-402f-9ac9-db13736fd7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:57.097037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d41a2-c8ac-402f-9ac9-db13736fd7c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:57.097329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d41a2-c8ac-402f-9ac9-db13736fd7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:57.097618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d41a2-c8ac-402f-9ac9-db13736fd7c6 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/d09ca68fdd5b4e178bcd6a5c8bccc4f9/roles/19d39213f2254bfab168b8c1148fd8db` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:57.113036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d41a2-c8ac-402f-9ac9-db13736fd7c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=d09ca68fdd5b4e178bcd6a5c8bccc4f9, role_id=19d39213f2254bfab168b8c1148fd8db)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:57.114476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d41a2-c8ac-402f-9ac9-db13736fd7c6 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:57.129993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 604/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:16:56 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/d09ca68fdd5b4e178bcd6a5c8bccc4f9/roles/19d39213f2254bfab168b8c1148fd8db => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:16:59.399709 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec5752-fa31-4505-92a9-ee516745c7e6 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:59.400276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec5752-fa31-4505-92a9-ee516745c7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:59.400276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec5752-fa31-4505-92a9-ee516745c7e6 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:59.401821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 629/1233] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:59.407216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380b7d-b2e9-4e67-b702-549481a2ef6b None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:59.407660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380b7d-b2e9-4e67-b702-549481a2ef6b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:59.407752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380b7d-b2e9-4e67-b702-549481a2ef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:59.432846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-cc380b7d-b2e9-4e67-b702-549481a2ef6b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:59.434577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-cc380b7d-b2e9-4e67-b702-549481a2ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:59.515723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 605/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:16:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:16:59.801114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec5752-fa31-4505-92a9-ee516745c7e6 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:59.830049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:59.911912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec5752-fa31-4505-92a9-ee516745c7e6 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:59.947842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459def5-028a-4ced-89b6-c0af96ab2e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:59.948790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459def5-028a-4ced-89b6-c0af96ab2e9c None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:59.949201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459def5-028a-4ced-89b6-c0af96ab2e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:59.949596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459def5-028a-4ced-89b6-c0af96ab2e9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:59.962689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459def5-028a-4ced-89b6-c0af96ab2e9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-0459def5-028a-4ced-89b6-c0af96ab2e9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:16:59.967469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:16:59.968527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:16:59.969391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 630/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Sep 16 19:16:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:16:59.975197 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380b7d-b2e9-4e67-b702-549481a2ef6b None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:00.039198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:00.095970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380b7d-b2e9-4e67-b702-549481a2ef6b None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:00.136488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e5f40-87a7-4364-8e3e-64c080793fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:00.137149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e5f40-87a7-4364-8e3e-64c080793fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:00.137422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e5f40-87a7-4364-8e3e-64c080793fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:00.137698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e5f40-87a7-4364-8e3e-64c080793fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:00.138491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e5f40-87a7-4364-8e3e-64c080793fa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:00.138819 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e5f40-87a7-4364-8e3e-64c080793fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:00.140375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e5f40-87a7-4364-8e3e-64c080793fa2 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:00.152437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 606/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Sep 16 19:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:17:00.155835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459def5-028a-4ced-89b6-c0af96ab2e9c None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:00.248460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:00.268008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459def5-028a-4ced-89b6-c0af96ab2e9c None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:00.306770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df319e-cf9a-4e1f-9cdd-3edd38905874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:00.307342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df319e-cf9a-4e1f-9cdd-3edd38905874 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:00.307620 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df319e-cf9a-4e1f-9cdd-3edd38905874 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:00.307889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df319e-cf9a-4e1f-9cdd-3edd38905874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:00.320733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df319e-cf9a-4e1f-9cdd-3edd38905874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:00.322429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df319e-cf9a-4e1f-9cdd-3edd38905874 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-d4df319e-cf9a-4e1f-9cdd-3edd38905874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:17:00.337686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:00.339069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:17:00.340330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:17:00.340330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:00.340330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:00.340330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 631/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:17:00.344926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e5f40-87a7-4364-8e3e-64c080793fa2 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:00.466580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e5f40-87a7-4364-8e3e-64c080793fa2 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:00.476516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:00.502121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f272d33-c780-4b33-ad18-7e74bbb2359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:00.502843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f272d33-c780-4b33-ad18-7e74bbb2359b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:00.503145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f272d33-c780-4b33-ad18-7e74bbb2359b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:00.503447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f272d33-c780-4b33-ad18-7e74bbb2359b None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:00.504209 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f272d33-c780-4b33-ad18-7e74bbb2359b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:00.504549 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f272d33-c780-4b33-ad18-7e74bbb2359b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:00.506343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f272d33-c780-4b33-ad18-7e74bbb2359b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:00.519600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 607/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:00.525702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df319e-cf9a-4e1f-9cdd-3edd38905874 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:00.631427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df319e-cf9a-4e1f-9cdd-3edd38905874 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:00.667596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dad9a6-2377-4a88-81d2-7f5dc5b628fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:00.668262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad9a6-2377-4a88-81d2-7f5dc5b628fa None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:00.668572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad9a6-2377-4a88-81d2-7f5dc5b628fa None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:00.668850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad9a6-2377-4a88-81d2-7f5dc5b628fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:00.671544 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:00.677047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dad9a6-2377-4a88-81d2-7f5dc5b628fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:00.678713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dad9a6-2377-4a88-81d2-7f5dc5b628fa None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-e7dad9a6-2377-4a88-81d2-7f5dc5b628fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:17:00.690700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:00.691871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:00.693460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 632/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:00.697780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f272d33-c780-4b33-ad18-7e74bbb2359b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:00.803164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f272d33-c780-4b33-ad18-7e74bbb2359b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:00.842946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda9a0c-b6eb-4b35-a07b-a248ede91666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:00.843536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9a0c-b6eb-4b35-a07b-a248ede91666 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:00.843812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9a0c-b6eb-4b35-a07b-a248ede91666 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:00.844074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9a0c-b6eb-4b35-a07b-a248ede91666 None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:00.844834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda9a0c-b6eb-4b35-a07b-a248ede91666 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:00.845132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda9a0c-b6eb-4b35-a07b-a248ede91666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:00.846553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda9a0c-b6eb-4b35-a07b-a248ede91666 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:00.866404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 608/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Sep 16 19:17:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:00.872404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dad9a6-2377-4a88-81d2-7f5dc5b628fa None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:00.983405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dad9a6-2377-4a88-81d2-7f5dc5b628fa None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:01.023371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf39f89-a437-4284-8ed0-df76bd29359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:01.023996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39f89-a437-4284-8ed0-df76bd29359a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:01.024275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39f89-a437-4284-8ed0-df76bd29359a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:01.024610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39f89-a437-4284-8ed0-df76bd29359a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:01.096439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:01.109092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf39f89-a437-4284-8ed0-df76bd29359a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:01.110604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf39f89-a437-4284-8ed0-df76bd29359a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:01.222954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 633/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:17:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:17:01.229603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda9a0c-b6eb-4b35-a07b-a248ede91666 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:01.260882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:01.343450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda9a0c-b6eb-4b35-a07b-a248ede91666 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:01.382228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab883-eae1-41b8-a60a-4034b621bacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:01.382777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab883-eae1-41b8-a60a-4034b621bacc None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:01.383054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab883-eae1-41b8-a60a-4034b621bacc None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:01.383325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab883-eae1-41b8-a60a-4034b621bacc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:01.393705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab883-eae1-41b8-a60a-4034b621bacc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:01.395159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab883-eae1-41b8-a60a-4034b621bacc None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-4ebab883-eae1-41b8-a60a-4034b621bacc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:17:01.414901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:01.416442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:17:01.417750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:17:01.417750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:01.417750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:01.417750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 609/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:17:01.422451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf39f89-a437-4284-8ed0-df76bd29359a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:01.538662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:01.545707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf39f89-a437-4284-8ed0-df76bd29359a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:01.585964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd74db-74f5-4d58-b87c-79feafcc4753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:01.586670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd74db-74f5-4d58-b87c-79feafcc4753 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:01.586946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd74db-74f5-4d58-b87c-79feafcc4753 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:01.587212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd74db-74f5-4d58-b87c-79feafcc4753 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:01.587857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd74db-74f5-4d58-b87c-79feafcc4753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:01.588155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd74db-74f5-4d58-b87c-79feafcc4753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:01.589574 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd74db-74f5-4d58-b87c-79feafcc4753 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:01.601780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 634/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:01.607735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab883-eae1-41b8-a60a-4034b621bacc None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:01.703887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:01.725371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab883-eae1-41b8-a60a-4034b621bacc None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:01.762708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522e67c-a2eb-4c2d-b385-024f3eb41c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:01.763353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522e67c-a2eb-4c2d-b385-024f3eb41c1d None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:01.763626 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522e67c-a2eb-4c2d-b385-024f3eb41c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:01.763892 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522e67c-a2eb-4c2d-b385-024f3eb41c1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:01.771493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522e67c-a2eb-4c2d-b385-024f3eb41c1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:01.773055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522e67c-a2eb-4c2d-b385-024f3eb41c1d None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-7522e67c-a2eb-4c2d-b385-024f3eb41c1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:17:01.785495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:01.786728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:01.787872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:17:01.787872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:17:01.787872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:17:01.787872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:17:01.787872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:17:01.787872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:17:01.787872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:17:01.787872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:01.787872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 610/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:01.792982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd74db-74f5-4d58-b87c-79feafcc4753 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:01.907229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd74db-74f5-4d58-b87c-79feafcc4753 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:01.946168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6191f-0c3f-442b-bfbd-6a876b307fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:01.946802 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6191f-0c3f-442b-bfbd-6a876b307fec None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:01.947084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6191f-0c3f-442b-bfbd-6a876b307fec None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:01.947381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6191f-0c3f-442b-bfbd-6a876b307fec None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:01.948105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6191f-0c3f-442b-bfbd-6a876b307fec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:01.948457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6191f-0c3f-442b-bfbd-6a876b307fec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:01.950135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6191f-0c3f-442b-bfbd-6a876b307fec None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:01.964200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 635/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:01.970776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522e67c-a2eb-4c2d-b385-024f3eb41c1d None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:02.083494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522e67c-a2eb-4c2d-b385-024f3eb41c1d None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:02.120714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd81d6-1df6-46ab-a563-10ea59848f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:02.121316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd81d6-1df6-46ab-a563-10ea59848f00 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:02.121588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd81d6-1df6-46ab-a563-10ea59848f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:02.121854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd81d6-1df6-46ab-a563-10ea59848f00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:02.122578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd81d6-1df6-46ab-a563-10ea59848f00 None admin] RBAC: Adding query filter params (role.id=19d39213f2254bfab168b8c1148fd8db, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=d09ca68fdd5b4e178bcd6a5c8bccc4f9) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:02.122880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd81d6-1df6-46ab-a563-10ea59848f00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:02.124300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd81d6-1df6-46ab-a563-10ea59848f00 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:02.130346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 611/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:17:01 2022] GET /identity/v3/role_assignments?user.id=d09ca68fdd5b4e178bcd6a5c8bccc4f9&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=19d39213f2254bfab168b8c1148fd8db => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:04.587751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c4135-38c1-415c-97a6-3b58a9c772b2 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:04.588375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c4135-38c1-415c-97a6-3b58a9c772b2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:04.588577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c4135-38c1-415c-97a6-3b58a9c772b2 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:04.590986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 636/1247] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:17:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:17:04.596215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714eea-10dc-404e-a7cf-abcb76c64a84 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:04.596665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714eea-10dc-404e-a7cf-abcb76c64a84 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:04.596775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714eea-10dc-404e-a7cf-abcb76c64a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:04.603489 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:04.616009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-83714eea-10dc-404e-a7cf-abcb76c64a84 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:17:04.617234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-83714eea-10dc-404e-a7cf-abcb76c64a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:17:04.690771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 612/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:17:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:17:04.958111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c4135-38c1-415c-97a6-3b58a9c772b2 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:04.977058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:05.074438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c4135-38c1-415c-97a6-3b58a9c772b2 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:05.112109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa6999-3718-4e1f-8f2f-cd2eab66b685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:05.112838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa6999-3718-4e1f-8f2f-cd2eab66b685 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:05.113068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa6999-3718-4e1f-8f2f-cd2eab66b685 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:05.113344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa6999-3718-4e1f-8f2f-cd2eab66b685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:05.125264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa6999-3718-4e1f-8f2f-cd2eab66b685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-c8fa6999-3718-4e1f-8f2f-cd2eab66b685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:17:05.130429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:05.131613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:05.132694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 637/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:17:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:05.137991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714eea-10dc-404e-a7cf-abcb76c64a84 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:05.249787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714eea-10dc-404e-a7cf-abcb76c64a84 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:05.283356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:05.289760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc274008-1cef-4aa3-be5e-eaaf499f842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:05.290389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc274008-1cef-4aa3-be5e-eaaf499f842b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:05.290671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc274008-1cef-4aa3-be5e-eaaf499f842b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:05.290944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc274008-1cef-4aa3-be5e-eaaf499f842b None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:05.291622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc274008-1cef-4aa3-be5e-eaaf499f842b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:05.291925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc274008-1cef-4aa3-be5e-eaaf499f842b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:05.293352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc274008-1cef-4aa3-be5e-eaaf499f842b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:05.301723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 613/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:17:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:05.307896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa6999-3718-4e1f-8f2f-cd2eab66b685 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:05.388449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:05.416851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa6999-3718-4e1f-8f2f-cd2eab66b685 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:05.464191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c0c91-c73f-4b09-83b6-4d47e9610a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:05.465237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c0c91-c73f-4b09-83b6-4d47e9610a05 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:05.465734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c0c91-c73f-4b09-83b6-4d47e9610a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:05.466226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c0c91-c73f-4b09-83b6-4d47e9610a05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:05.481873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c0c91-c73f-4b09-83b6-4d47e9610a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:05.481873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c0c91-c73f-4b09-83b6-4d47e9610a05 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-342c0c91-c73f-4b09-83b6-4d47e9610a05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:17:05.498142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:05.499387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:17:05.500533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:17:05.500533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:05.500533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:05.500533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 638/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:05.505979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc274008-1cef-4aa3-be5e-eaaf499f842b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:05.618486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc274008-1cef-4aa3-be5e-eaaf499f842b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:05.656359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e9d6c-44fa-4c53-ab83-2dd289c2fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:05.657006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9d6c-44fa-4c53-ab83-2dd289c2fb51 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:05.657286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9d6c-44fa-4c53-ab83-2dd289c2fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:05.657555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9d6c-44fa-4c53-ab83-2dd289c2fb51 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:05.658187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e9d6c-44fa-4c53-ab83-2dd289c2fb51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:05.658493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e9d6c-44fa-4c53-ab83-2dd289c2fb51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:05.659862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e9d6c-44fa-4c53-ab83-2dd289c2fb51 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:05.674541 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 614/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:17:05.680778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c0c91-c73f-4b09-83b6-4d47e9610a05 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:05.796176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c0c91-c73f-4b09-83b6-4d47e9610a05 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:05.823670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:05.831758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3adae-6bb2-464b-89e6-adeb394f32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:05.832420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3adae-6bb2-464b-89e6-adeb394f32d6 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:05.832693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3adae-6bb2-464b-89e6-adeb394f32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:05.832958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3adae-6bb2-464b-89e6-adeb394f32d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:05.841003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3adae-6bb2-464b-89e6-adeb394f32d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:05.842457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3adae-6bb2-464b-89e6-adeb394f32d6 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-cea3adae-6bb2-464b-89e6-adeb394f32d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:17:05.853555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:05.854706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:05.855682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 639/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:05.861411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e9d6c-44fa-4c53-ab83-2dd289c2fb51 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:05.922905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:05.977544 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e9d6c-44fa-4c53-ab83-2dd289c2fb51 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:06.018695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed154d9-dda7-4d13-a30f-9c81a79fd01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:06.019220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed154d9-dda7-4d13-a30f-9c81a79fd01b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:06.019493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed154d9-dda7-4d13-a30f-9c81a79fd01b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:06.019762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed154d9-dda7-4d13-a30f-9c81a79fd01b None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:06.020526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed154d9-dda7-4d13-a30f-9c81a79fd01b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:06.020930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed154d9-dda7-4d13-a30f-9c81a79fd01b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:06.022473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed154d9-dda7-4d13-a30f-9c81a79fd01b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:06.041191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 615/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Sep 16 19:17:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:06.047895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3adae-6bb2-464b-89e6-adeb394f32d6 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:06.161766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3adae-6bb2-464b-89e6-adeb394f32d6 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:06.199271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db881eb5-6e7b-4435-ba91-d0acab66f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:06.199882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db881eb5-6e7b-4435-ba91-d0acab66f972 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:06.200173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db881eb5-6e7b-4435-ba91-d0acab66f972 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:06.200456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db881eb5-6e7b-4435-ba91-d0acab66f972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:06.261142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:06.275981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db881eb5-6e7b-4435-ba91-d0acab66f972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:06.277854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db881eb5-6e7b-4435-ba91-d0acab66f972 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:06.396271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 640/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:17:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:17:06.402481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed154d9-dda7-4d13-a30f-9c81a79fd01b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:06.515173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed154d9-dda7-4d13-a30f-9c81a79fd01b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:06.530258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:06.553919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10573a-cf62-491e-b371-88684e73a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:06.554559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10573a-cf62-491e-b371-88684e73a663 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:06.554827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10573a-cf62-491e-b371-88684e73a663 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:06.555092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10573a-cf62-491e-b371-88684e73a663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:06.566723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10573a-cf62-491e-b371-88684e73a663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:06.568251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10573a-cf62-491e-b371-88684e73a663 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-4c10573a-cf62-491e-b371-88684e73a663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:17:06.584262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:06.585542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:17:06.586617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:17:06.586617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:06.586617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:06.586617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 616/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:06.591565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db881eb5-6e7b-4435-ba91-d0acab66f972 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:06.694780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:06.709215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db881eb5-6e7b-4435-ba91-d0acab66f972 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:06.748406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22699e-98cd-4518-965d-5abaabb0f327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:06.749044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22699e-98cd-4518-965d-5abaabb0f327 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:06.749300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22699e-98cd-4518-965d-5abaabb0f327 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:06.749588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22699e-98cd-4518-965d-5abaabb0f327 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:06.750231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22699e-98cd-4518-965d-5abaabb0f327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:06.750526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22699e-98cd-4518-965d-5abaabb0f327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:06.751926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22699e-98cd-4518-965d-5abaabb0f327 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:06.765506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 641/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:06.772846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10573a-cf62-491e-b371-88684e73a663 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:06.877011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10573a-cf62-491e-b371-88684e73a663 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:06.911674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139d60-ff6c-4599-a779-aca275a8193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:06.912326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139d60-ff6c-4599-a779-aca275a8193b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:06.912624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139d60-ff6c-4599-a779-aca275a8193b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:06.912888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139d60-ff6c-4599-a779-aca275a8193b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:06.919580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139d60-ff6c-4599-a779-aca275a8193b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:06.921054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139d60-ff6c-4599-a779-aca275a8193b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-f0139d60-ff6c-4599-a779-aca275a8193b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:17:06.932550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:06.934000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:06.935290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:17:06.935290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:17:06.935290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:17:06.935290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:17:06.935290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:17:06.935290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:17:06.935290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:17:06.935290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:06.935290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 617/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:06.939923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22699e-98cd-4518-965d-5abaabb0f327 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:07.042133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22699e-98cd-4518-965d-5abaabb0f327 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:07.078048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5ade4-c6b5-4cee-a531-fbff69b4dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:07.078642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ade4-c6b5-4cee-a531-fbff69b4dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:07.078912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ade4-c6b5-4cee-a531-fbff69b4dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:07.079179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ade4-c6b5-4cee-a531-fbff69b4dcb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:07.079857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5ade4-c6b5-4cee-a531-fbff69b4dcb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:07.080159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5ade4-c6b5-4cee-a531-fbff69b4dcb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:07.081601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5ade4-c6b5-4cee-a531-fbff69b4dcb3 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:07.093495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 642/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:07.100799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139d60-ff6c-4599-a779-aca275a8193b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:07.135106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:07.215895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139d60-ff6c-4599-a779-aca275a8193b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:07.256667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d5590-792a-497e-b9d1-24b3c51d1d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:07.257265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d5590-792a-497e-b9d1-24b3c51d1d40 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:07.257539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d5590-792a-497e-b9d1-24b3c51d1d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:07.257810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d5590-792a-497e-b9d1-24b3c51d1d40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:07.258535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d5590-792a-497e-b9d1-24b3c51d1d40 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=d09ca68fdd5b4e178bcd6a5c8bccc4f9) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:07.258842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d5590-792a-497e-b9d1-24b3c51d1d40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:07.260281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d5590-792a-497e-b9d1-24b3c51d1d40 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:07.265590 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 618/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:17:07 2022] GET /identity/v3/role_assignments?user.id=d09ca68fdd5b4e178bcd6a5c8bccc4f9&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=71bed99a52684ba990097719b40ef99d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:09.389969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1072508-c697-4f19-b3b0-30b3f01762fd None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:09.390555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1072508-c697-4f19-b3b0-30b3f01762fd None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:09.390555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1072508-c697-4f19-b3b0-30b3f01762fd None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:09.392642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 643/1261] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:17:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:17:09.399395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e015e-bef0-4fec-861f-89acb467a167 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:09.399863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e015e-bef0-4fec-861f-89acb467a167 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:09.399968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e015e-bef0-4fec-861f-89acb467a167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:09.420703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-666e015e-bef0-4fec-861f-89acb467a167 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:17:09.422001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-666e015e-bef0-4fec-861f-89acb467a167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:17:09.500972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 619/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:17:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:17:09.767111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1072508-c697-4f19-b3b0-30b3f01762fd None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:09.778689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:09.885879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1072508-c697-4f19-b3b0-30b3f01762fd None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:09.920963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c4326-a518-4776-8035-fe9fe9b89968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:09.921587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c4326-a518-4776-8035-fe9fe9b89968 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:09.921872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c4326-a518-4776-8035-fe9fe9b89968 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:09.922125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c4326-a518-4776-8035-fe9fe9b89968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:09.933294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c4326-a518-4776-8035-fe9fe9b89968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-a40c4326-a518-4776-8035-fe9fe9b89968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:17:09.938052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:09.939117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:09.940131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 644/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:09.945634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e015e-bef0-4fec-861f-89acb467a167 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:09.965119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:10.048548 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e015e-bef0-4fec-861f-89acb467a167 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:10.091202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaac67b-6ae6-44a8-9952-9e194f0594a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:10.091807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaac67b-6ae6-44a8-9952-9e194f0594a8 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:10.092087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaac67b-6ae6-44a8-9952-9e194f0594a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:10.092330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaac67b-6ae6-44a8-9952-9e194f0594a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:10.093055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaac67b-6ae6-44a8-9952-9e194f0594a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:10.093356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaac67b-6ae6-44a8-9952-9e194f0594a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:10.094726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaac67b-6ae6-44a8-9952-9e194f0594a8 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:10.103835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 620/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:10.110115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c4326-a518-4776-8035-fe9fe9b89968 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:10.183922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:10.225954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c4326-a518-4776-8035-fe9fe9b89968 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:10.261328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd598bb5-b99e-46d8-b2fe-5fe1e348c85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:10.261944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd598bb5-b99e-46d8-b2fe-5fe1e348c85d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:10.262216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd598bb5-b99e-46d8-b2fe-5fe1e348c85d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:10.262481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd598bb5-b99e-46d8-b2fe-5fe1e348c85d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:10.273599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd598bb5-b99e-46d8-b2fe-5fe1e348c85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:10.275074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd598bb5-b99e-46d8-b2fe-5fe1e348c85d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-fd598bb5-b99e-46d8-b2fe-5fe1e348c85d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:17:10.289852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:10.290926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:17:10.292165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:17:10.292165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:10.292165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:10.292165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 645/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:10.299657 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaac67b-6ae6-44a8-9952-9e194f0594a8 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:10.382950 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:10.403520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaac67b-6ae6-44a8-9952-9e194f0594a8 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:10.439870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785884a8-23cc-453a-b98f-51798d31fc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:10.440521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785884a8-23cc-453a-b98f-51798d31fc2a None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:10.440807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785884a8-23cc-453a-b98f-51798d31fc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:10.441095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785884a8-23cc-453a-b98f-51798d31fc2a None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:10.441739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785884a8-23cc-453a-b98f-51798d31fc2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:10.442051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785884a8-23cc-453a-b98f-51798d31fc2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:10.443661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785884a8-23cc-453a-b98f-51798d31fc2a None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:10.460953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 621/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:10.467481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd598bb5-b99e-46d8-b2fe-5fe1e348c85d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:10.604010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd598bb5-b99e-46d8-b2fe-5fe1e348c85d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:10.624659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:10.639027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa68e9-1eee-4035-8537-cfa1a947007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:10.639659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa68e9-1eee-4035-8537-cfa1a947007a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:10.639934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa68e9-1eee-4035-8537-cfa1a947007a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:10.640202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa68e9-1eee-4035-8537-cfa1a947007a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:10.648275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa68e9-1eee-4035-8537-cfa1a947007a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:10.649758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa68e9-1eee-4035-8537-cfa1a947007a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-4eaa68e9-1eee-4035-8537-cfa1a947007a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:17:10.661630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:10.662689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:10.663887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 646/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:10.670585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785884a8-23cc-453a-b98f-51798d31fc2a None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:10.784574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785884a8-23cc-453a-b98f-51798d31fc2a None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:10.818170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd5556-de2f-43ba-b2f6-47b88fbec18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:10.818763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd5556-de2f-43ba-b2f6-47b88fbec18b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:10.819039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd5556-de2f-43ba-b2f6-47b88fbec18b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:10.819315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd5556-de2f-43ba-b2f6-47b88fbec18b None admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:10.820035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd5556-de2f-43ba-b2f6-47b88fbec18b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:10.820330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd5556-de2f-43ba-b2f6-47b88fbec18b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:10.821785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd5556-de2f-43ba-b2f6-47b88fbec18b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:10.830138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:10.844029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 622/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Sep 16 19:17:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:17:10.851952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa68e9-1eee-4035-8537-cfa1a947007a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:10.969832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa68e9-1eee-4035-8537-cfa1a947007a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:11.006060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb9c1-00f8-47a9-af8a-7b86311a7e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:11.006702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb9c1-00f8-47a9-af8a-7b86311a7e6b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:11.006976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb9c1-00f8-47a9-af8a-7b86311a7e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:11.007248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb9c1-00f8-47a9-af8a-7b86311a7e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:11.018192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4eb9c1-00f8-47a9-af8a-7b86311a7e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:11.019659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4eb9c1-00f8-47a9-af8a-7b86311a7e6b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-1d4eb9c1-00f8-47a9-af8a-7b86311a7e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:17:11.034216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:11.035221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:17:11.036343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:17:11.036343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:11.036343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:11.036343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 647/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:17:11.042179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd5556-de2f-43ba-b2f6-47b88fbec18b None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:11.153266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd5556-de2f-43ba-b2f6-47b88fbec18b None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:11.193989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018acbb-d6b3-4765-89e4-23ae1bd34265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:11.194621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018acbb-d6b3-4765-89e4-23ae1bd34265 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:11.194892 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018acbb-d6b3-4765-89e4-23ae1bd34265 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:11.195159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018acbb-d6b3-4765-89e4-23ae1bd34265 None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:11.195787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018acbb-d6b3-4765-89e4-23ae1bd34265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:11.196205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018acbb-d6b3-4765-89e4-23ae1bd34265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:11.198368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018acbb-d6b3-4765-89e4-23ae1bd34265 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:11.212697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 623/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:11.219330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb9c1-00f8-47a9-af8a-7b86311a7e6b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:11.263136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:11.345321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb9c1-00f8-47a9-af8a-7b86311a7e6b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:11.381651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823daca-6fce-405c-997f-e2997a21623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:11.382268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823daca-6fce-405c-997f-e2997a21623b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:11.382540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823daca-6fce-405c-997f-e2997a21623b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:11.382804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823daca-6fce-405c-997f-e2997a21623b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:11.389758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823daca-6fce-405c-997f-e2997a21623b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:11.391194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823daca-6fce-405c-997f-e2997a21623b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-d823daca-6fce-405c-997f-e2997a21623b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:17:11.402888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:11.403891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:11.404937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:17:11.404937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:17:11.404937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:17:11.404937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:17:11.404937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:17:11.404937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:17:11.404937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:17:11.404937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:11.404937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 648/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:11.410957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018acbb-d6b3-4765-89e4-23ae1bd34265 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:11.474943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:11.520672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018acbb-d6b3-4765-89e4-23ae1bd34265 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:11.569654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18526e-45dc-4077-b9b4-9922e1205095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:11.570258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18526e-45dc-4077-b9b4-9922e1205095 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:11.570527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18526e-45dc-4077-b9b4-9922e1205095 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:11.570800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18526e-45dc-4077-b9b4-9922e1205095 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:11.571484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18526e-45dc-4077-b9b4-9922e1205095 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:11.571784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18526e-45dc-4077-b9b4-9922e1205095 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:11.573251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18526e-45dc-4077-b9b4-9922e1205095 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:11.585284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 624/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:11.595088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823daca-6fce-405c-997f-e2997a21623b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:11.698543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:11.710166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823daca-6fce-405c-997f-e2997a21623b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:11.745841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09bc32-3b3f-4e7e-a1ac-de54ec2a4538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:11.746493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09bc32-3b3f-4e7e-a1ac-de54ec2a4538 None admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:11.746764 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09bc32-3b3f-4e7e-a1ac-de54ec2a4538 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:11.747042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09bc32-3b3f-4e7e-a1ac-de54ec2a4538 None admin] PATH_INFO: `/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/d09ca68fdd5b4e178bcd6a5c8bccc4f9/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:11.749306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09bc32-3b3f-4e7e-a1ac-de54ec2a4538 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb58dd0ddf304a16a5ec9d3c60f684f2, user_id=d09ca68fdd5b4e178bcd6a5c8bccc4f9, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:11.750753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09bc32-3b3f-4e7e-a1ac-de54ec2a4538 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:11.767919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 649/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Sep 16 19:17:11 2022] PUT /identity/v3/projects/eb58dd0ddf304a16a5ec9d3c60f684f2/users/d09ca68fdd5b4e178bcd6a5c8bccc4f9/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:17:13.868761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d61a8b-b35d-4e8b-8d77-f79de6f02a76 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:13.869310 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d61a8b-b35d-4e8b-8d77-f79de6f02a76 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:13.869310 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d61a8b-b35d-4e8b-8d77-f79de6f02a76 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:13.871407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 625/1274] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:17:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:17:13.879480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f457c-7c8b-4082-b066-e5c741f9efcc None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:13.880130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f457c-7c8b-4082-b066-e5c741f9efcc None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:13.880130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f457c-7c8b-4082-b066-e5c741f9efcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:13.899971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-e90f457c-7c8b-4082-b066-e5c741f9efcc None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:17:13.901176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e90f457c-7c8b-4082-b066-e5c741f9efcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:17:13.977691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 650/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:17:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:17:14.245278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d61a8b-b35d-4e8b-8d77-f79de6f02a76 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:14.352532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d61a8b-b35d-4e8b-8d77-f79de6f02a76 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:14.371205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:14.389979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441cc5f-72b1-43fb-bc6f-e12f68677743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:14.390604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441cc5f-72b1-43fb-bc6f-e12f68677743 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:14.390883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441cc5f-72b1-43fb-bc6f-e12f68677743 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:14.391159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441cc5f-72b1-43fb-bc6f-e12f68677743 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:14.401975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441cc5f-72b1-43fb-bc6f-e12f68677743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-8441cc5f-72b1-43fb-bc6f-e12f68677743 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:17:14.406932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:14.408024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:14.408909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 626/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Sep 16 19:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:14.415952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f457c-7c8b-4082-b066-e5c741f9efcc None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:14.510819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:14.530302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f457c-7c8b-4082-b066-e5c741f9efcc None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:14.566540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c39a5-3965-4939-be65-5edb242a3f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:14.567711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c39a5-3965-4939-be65-5edb242a3f9a None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:14.567990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c39a5-3965-4939-be65-5edb242a3f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:14.568261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c39a5-3965-4939-be65-5edb242a3f9a None admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:14.568954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c39a5-3965-4939-be65-5edb242a3f9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:14.569259 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c39a5-3965-4939-be65-5edb242a3f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:14.570632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c39a5-3965-4939-be65-5edb242a3f9a None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:14.580838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 651/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Sep 16 19:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:14.587600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441cc5f-72b1-43fb-bc6f-e12f68677743 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:14.693536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441cc5f-72b1-43fb-bc6f-e12f68677743 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:14.728922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6908c-eb21-4c21-b898-f949401e04e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:14.729543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6908c-eb21-4c21-b898-f949401e04e3 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:14.729818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6908c-eb21-4c21-b898-f949401e04e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:14.730093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6908c-eb21-4c21-b898-f949401e04e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:14.741053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6908c-eb21-4c21-b898-f949401e04e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:14.742505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6908c-eb21-4c21-b898-f949401e04e3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-2cd6908c-eb21-4c21-b898-f949401e04e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:17:14.757898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:14.759049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:17:14.760093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:17:14.760093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:14.760093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:14.760093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 627/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:14.765199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c39a5-3965-4939-be65-5edb242a3f9a None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:14.871757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c39a5-3965-4939-be65-5edb242a3f9a None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:14.908796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7d2dc-078f-43f1-95dd-733f72284267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:14.909418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7d2dc-078f-43f1-95dd-733f72284267 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:14.909659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7d2dc-078f-43f1-95dd-733f72284267 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:14.909931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7d2dc-078f-43f1-95dd-733f72284267 None admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:14.910607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7d2dc-078f-43f1-95dd-733f72284267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:14.910913 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7d2dc-078f-43f1-95dd-733f72284267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:14.912296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7d2dc-078f-43f1-95dd-733f72284267 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:14.924288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 652/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:14.930400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6908c-eb21-4c21-b898-f949401e04e3 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:14.962704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:15.046399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6908c-eb21-4c21-b898-f949401e04e3 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:15.090823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82752a11-ebe5-4911-8c5a-d23efaa79c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:15.091701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82752a11-ebe5-4911-8c5a-d23efaa79c4c None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:15.092070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82752a11-ebe5-4911-8c5a-d23efaa79c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:15.092461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82752a11-ebe5-4911-8c5a-d23efaa79c4c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:15.102547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82752a11-ebe5-4911-8c5a-d23efaa79c4c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:15.103997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82752a11-ebe5-4911-8c5a-d23efaa79c4c None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-82752a11-ebe5-4911-8c5a-d23efaa79c4c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:17:15.115743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:15.116856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:15.118028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 628/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:15.123386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7d2dc-078f-43f1-95dd-733f72284267 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:15.129677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:15.233696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7d2dc-078f-43f1-95dd-733f72284267 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:15.272018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406e3b7-12c7-4c34-88f3-7180a8a1b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:15.273050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406e3b7-12c7-4c34-88f3-7180a8a1b58f None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:15.273533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406e3b7-12c7-4c34-88f3-7180a8a1b58f None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:15.274006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406e3b7-12c7-4c34-88f3-7180a8a1b58f None admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:15.275308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406e3b7-12c7-4c34-88f3-7180a8a1b58f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:15.275860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406e3b7-12c7-4c34-88f3-7180a8a1b58f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:15.277395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406e3b7-12c7-4c34-88f3-7180a8a1b58f None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:15.297287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 653/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Sep 16 19:17:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:15.304185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82752a11-ebe5-4911-8c5a-d23efaa79c4c None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:15.407627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:15.417489 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82752a11-ebe5-4911-8c5a-d23efaa79c4c None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:15.452279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215cfd-3b37-4f6b-ac1c-e7b5a018347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:15.452940 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215cfd-3b37-4f6b-ac1c-e7b5a018347e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:15.453212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215cfd-3b37-4f6b-ac1c-e7b5a018347e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:15.453485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215cfd-3b37-4f6b-ac1c-e7b5a018347e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:15.522162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa215cfd-3b37-4f6b-ac1c-e7b5a018347e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:15.523602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa215cfd-3b37-4f6b-ac1c-e7b5a018347e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:15.631170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:15.648266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 629/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Sep 16 19:17:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:17:15.654395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406e3b7-12c7-4c34-88f3-7180a8a1b58f None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:15.723741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:15.765174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406e3b7-12c7-4c34-88f3-7180a8a1b58f None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:15.803645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dfd77-2ea9-40f7-bcf3-ad9792a4028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:15.804274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dfd77-2ea9-40f7-bcf3-ad9792a4028d None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:15.804606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dfd77-2ea9-40f7-bcf3-ad9792a4028d None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:15.804879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dfd77-2ea9-40f7-bcf3-ad9792a4028d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:15.816720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dfd77-2ea9-40f7-bcf3-ad9792a4028d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:15.818198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dfd77-2ea9-40f7-bcf3-ad9792a4028d None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-385dfd77-2ea9-40f7-bcf3-ad9792a4028d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:17:15.835193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:15.836305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:17:15.837303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:17:15.837303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:17:15.837303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:15.837303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 654/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:15.842407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215cfd-3b37-4f6b-ac1c-e7b5a018347e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:15.953074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215cfd-3b37-4f6b-ac1c-e7b5a018347e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:15.989574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d624-da9e-4716-ae3a-f2664ed424ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:15.990285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d624-da9e-4716-ae3a-f2664ed424ca None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:15.990934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d624-da9e-4716-ae3a-f2664ed424ca None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:15.991213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d624-da9e-4716-ae3a-f2664ed424ca None admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:15.991863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06d624-da9e-4716-ae3a-f2664ed424ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:15.992161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06d624-da9e-4716-ae3a-f2664ed424ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:15.993559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06d624-da9e-4716-ae3a-f2664ed424ca None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:16.009964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 630/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Sep 16 19:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:16.016003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dfd77-2ea9-40f7-bcf3-ad9792a4028d None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:16.121522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dfd77-2ea9-40f7-bcf3-ad9792a4028d None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:16.135876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:16.160540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa2e9-a550-4490-93f1-5e875bd03431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:16.161174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa2e9-a550-4490-93f1-5e875bd03431 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:16.161452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa2e9-a550-4490-93f1-5e875bd03431 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:16.161721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa2e9-a550-4490-93f1-5e875bd03431 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:16.168959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfa2e9-a550-4490-93f1-5e875bd03431 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:16.170407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfa2e9-a550-4490-93f1-5e875bd03431 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application [None req-88dfa2e9-a550-4490-93f1-5e875bd03431 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:17:16.182108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:16.183438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:16.184367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:17:16.184367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:17:16.184367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:17:16.184367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:17:16.184367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:17:16.184367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:17:16.184367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:17:16.184367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: ERROR keystone.server.flask.application Sep 16 19:17:16.184367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 655/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Sep 16 19:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:16.189572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d624-da9e-4716-ae3a-f2664ed424ca None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:16.245592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:16.303068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d624-da9e-4716-ae3a-f2664ed424ca None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:16.341248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c0d58-12a5-4e79-a0fd-8b361a6b4797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:16.341847 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c0d58-12a5-4e79-a0fd-8b361a6b4797 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:16.342127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c0d58-12a5-4e79-a0fd-8b361a6b4797 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:16.342401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c0d58-12a5-4e79-a0fd-8b361a6b4797 None admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:16.343086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c0d58-12a5-4e79-a0fd-8b361a6b4797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:16.343387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c0d58-12a5-4e79-a0fd-8b361a6b4797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:16.344888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c0d58-12a5-4e79-a0fd-8b361a6b4797 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:16.356913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 631/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Sep 16 19:17:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:16.363418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa2e9-a550-4490-93f1-5e875bd03431 None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:16.468584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa2e9-a550-4490-93f1-5e875bd03431 None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:16.503708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74166744-9f07-49fd-8388-d67a67706881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:16.504241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74166744-9f07-49fd-8388-d67a67706881 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:16.504553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74166744-9f07-49fd-8388-d67a67706881 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:16.504822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74166744-9f07-49fd-8388-d67a67706881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:16.505553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74166744-9f07-49fd-8388-d67a67706881 None admin] RBAC: Adding query filter params (role.id=71bed99a52684ba990097719b40ef99d, scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2, user.id=d09ca68fdd5b4e178bcd6a5c8bccc4f9) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:16.505999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74166744-9f07-49fd-8388-d67a67706881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:16.507518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74166744-9f07-49fd-8388-d67a67706881 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:16.513410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 656/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Sep 16 19:17:16 2022] GET /identity/v3/role_assignments?user.id=d09ca68fdd5b4e178bcd6a5c8bccc4f9&scope.project.id=eb58dd0ddf304a16a5ec9d3c60f684f2&role.id=71bed99a52684ba990097719b40ef99d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:18.686146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106ce1-0135-400a-8b96-10dc7f4d8b06 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:18.686718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106ce1-0135-400a-8b96-10dc7f4d8b06 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:18.686718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106ce1-0135-400a-8b96-10dc7f4d8b06 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:18.688039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 632/1288] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:17:18.695044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16d45-837c-49c2-99cd-1a5dbd8696ad None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:18.695768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16d45-837c-49c2-99cd-1a5dbd8696ad None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:18.695991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16d45-837c-49c2-99cd-1a5dbd8696ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:18.721218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d2c16d45-837c-49c2-99cd-1a5dbd8696ad None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:17:18.722407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d2c16d45-837c-49c2-99cd-1a5dbd8696ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:17:18.756695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:18.799285 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 657/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:17:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:17:19.062626 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106ce1-0135-400a-8b96-10dc7f4d8b06 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:19.169744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106ce1-0135-400a-8b96-10dc7f4d8b06 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:19.180877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:19.207463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faca0b-5b03-4172-ae78-cff236b1b36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:19.208084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faca0b-5b03-4172-ae78-cff236b1b36e None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:19.208354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faca0b-5b03-4172-ae78-cff236b1b36e None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:19.208702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faca0b-5b03-4172-ae78-cff236b1b36e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:19.209599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faca0b-5b03-4172-ae78-cff236b1b36e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:19.210965 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faca0b-5b03-4172-ae78-cff236b1b36e None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-a7faca0b-5b03-4172-ae78-cff236b1b36e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:19.220417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:19.221636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:19.222542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 633/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Sep 16 19:17:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:19.228087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16d45-837c-49c2-99cd-1a5dbd8696ad None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:19.329954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16d45-837c-49c2-99cd-1a5dbd8696ad None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:19.364307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e563521-4d7c-4fdd-872d-2938da987739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:19.365169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e563521-4d7c-4fdd-872d-2938da987739 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:19.365539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e563521-4d7c-4fdd-872d-2938da987739 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:19.365814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e563521-4d7c-4fdd-872d-2938da987739 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:19.366425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e563521-4d7c-4fdd-872d-2938da987739 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:19.366725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e563521-4d7c-4fdd-872d-2938da987739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:19.368097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e563521-4d7c-4fdd-872d-2938da987739 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:19.373012 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 658/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Sep 16 19:17:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:19.378983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faca0b-5b03-4172-ae78-cff236b1b36e None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:19.500415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faca0b-5b03-4172-ae78-cff236b1b36e None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:19.540272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690f5e0-c479-4a25-a939-04459ddd60e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:19.540888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690f5e0-c479-4a25-a939-04459ddd60e3 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:19.541159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690f5e0-c479-4a25-a939-04459ddd60e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:19.541427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690f5e0-c479-4a25-a939-04459ddd60e3 None admin] PATH_INFO: `/v3/services` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:19.542046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690f5e0-c479-4a25-a939-04459ddd60e3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:19.542349 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690f5e0-c479-4a25-a939-04459ddd60e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:19.543703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690f5e0-c479-4a25-a939-04459ddd60e3 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:19.548333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 634/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Sep 16 19:17:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:21.656842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e3977-be58-4121-bbb7-adf7db516936 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:21.657747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e3977-be58-4121-bbb7-adf7db516936 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:21.657747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e3977-be58-4121-bbb7-adf7db516936 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:21.659923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 659/1293] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:17:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:17:21.665465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7beb1-0b88-40f4-b692-27b0702be761 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:21.665911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7beb1-0b88-40f4-b692-27b0702be761 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:21.666003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7beb1-0b88-40f4-b692-27b0702be761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:21.685929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-16a7beb1-0b88-40f4-b692-27b0702be761 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:17:21.687087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-16a7beb1-0b88-40f4-b692-27b0702be761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:17:21.717545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:21.761816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 635/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:17:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:17:22.036117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e3977-be58-4121-bbb7-adf7db516936 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:22.085772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:22.170453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e3977-be58-4121-bbb7-adf7db516936 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:22.205385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4b25-b768-4eeb-ab6c-38a66c7cb231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:22.205980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4b25-b768-4eeb-ab6c-38a66c7cb231 None admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:22.206254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4b25-b768-4eeb-ab6c-38a66c7cb231 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:22.206520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4b25-b768-4eeb-ab6c-38a66c7cb231 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:22.207169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4b25-b768-4eeb-ab6c-38a66c7cb231 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:22.208636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4b25-b768-4eeb-ab6c-38a66c7cb231 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:22.226544 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 660/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Sep 16 19:17:22 2022] POST /identity/v3/services => generated 246 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:17:24.339615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ac44d-7771-418c-9d40-af89e7f2a26d None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:24.340233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ac44d-7771-418c-9d40-af89e7f2a26d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:24.340233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ac44d-7771-418c-9d40-af89e7f2a26d None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:24.341529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 636/1296] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:17:24.347904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc1c3e-3040-4bf7-9422-8e2e14a693b6 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:24.348710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc1c3e-3040-4bf7-9422-8e2e14a693b6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:24.348905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc1c3e-3040-4bf7-9422-8e2e14a693b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:24.375377 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-a6dc1c3e-3040-4bf7-9422-8e2e14a693b6 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:17:24.376606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a6dc1c3e-3040-4bf7-9422-8e2e14a693b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:17:24.464068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 661/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:17:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:17:24.740680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ac44d-7771-418c-9d40-af89e7f2a26d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:24.851635 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ac44d-7771-418c-9d40-af89e7f2a26d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:24.890380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435f088-db1c-4938-97fe-012ad72604f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:24.890994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435f088-db1c-4938-97fe-012ad72604f1 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:24.891267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435f088-db1c-4938-97fe-012ad72604f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:24.891538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435f088-db1c-4938-97fe-012ad72604f1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:24.892121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435f088-db1c-4938-97fe-012ad72604f1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:24.893520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435f088-db1c-4938-97fe-012ad72604f1 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-c435f088-db1c-4938-97fe-012ad72604f1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:24.902677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:24.903941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:24.904978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 637/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Sep 16 19:17:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:24.910763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc1c3e-3040-4bf7-9422-8e2e14a693b6 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:24.931000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:25.027843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc1c3e-3040-4bf7-9422-8e2e14a693b6 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:25.063758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c234d1a-b7bb-4443-8e38-715fc2b8fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:25.064356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c234d1a-b7bb-4443-8e38-715fc2b8fb6b None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:25.064658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c234d1a-b7bb-4443-8e38-715fc2b8fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:25.064933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c234d1a-b7bb-4443-8e38-715fc2b8fb6b None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:25.065559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c234d1a-b7bb-4443-8e38-715fc2b8fb6b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:25.065861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c234d1a-b7bb-4443-8e38-715fc2b8fb6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:25.067245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c234d1a-b7bb-4443-8e38-715fc2b8fb6b None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:25.073138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 662/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Sep 16 19:17:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:25.083317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435f088-db1c-4938-97fe-012ad72604f1 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:25.118111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:25.189592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435f088-db1c-4938-97fe-012ad72604f1 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:25.225974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd2e83-1802-4157-a422-d8b579ddbb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:25.226857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2e83-1802-4157-a422-d8b579ddbb6b None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:25.227238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2e83-1802-4157-a422-d8b579ddbb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:25.227616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2e83-1802-4157-a422-d8b579ddbb6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:25.228797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd2e83-1802-4157-a422-d8b579ddbb6b None admin] RBAC: Adding query filter params (interface=public, service_id=cffe4bad301f439d966046b5528f4629, region_id=RegionOne) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:25.229257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd2e83-1802-4157-a422-d8b579ddbb6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:25.231407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd2e83-1802-4157-a422-d8b579ddbb6b None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:25.239708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 638/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Sep 16 19:17:25 2022] GET /identity/v3/endpoints?service_id=cffe4bad301f439d966046b5528f4629&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:25.248053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c234d1a-b7bb-4443-8e38-715fc2b8fb6b None admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:25.334134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:25.365281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c234d1a-b7bb-4443-8e38-715fc2b8fb6b None admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:25.401313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e7080-569e-4807-a346-0c033fc52986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:25.401919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7080-569e-4807-a346-0c033fc52986 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:25.402191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7080-569e-4807-a346-0c033fc52986 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:25.402457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7080-569e-4807-a346-0c033fc52986 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:25.403097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e7080-569e-4807-a346-0c033fc52986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:25.404497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e7080-569e-4807-a346-0c033fc52986 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:25.411980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 663/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Sep 16 19:17:25 2022] GET /identity/v3/services => generated 2191 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:17:27.529783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb292e1-50e7-4a49-8070-38e611ff2309 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:27.530382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb292e1-50e7-4a49-8070-38e611ff2309 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:27.530382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb292e1-50e7-4a49-8070-38e611ff2309 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:27.531660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 639/1302] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:17:27.538963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fbb5f-c6ce-457e-ba5b-dec674d6abb0 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:27.539660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fbb5f-c6ce-457e-ba5b-dec674d6abb0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:27.539849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fbb5f-c6ce-457e-ba5b-dec674d6abb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:27.564484 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-527fbb5f-c6ce-457e-ba5b-dec674d6abb0 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:17:27.565677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-527fbb5f-c6ce-457e-ba5b-dec674d6abb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:17:27.642684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 664/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:17:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:17:27.906612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb292e1-50e7-4a49-8070-38e611ff2309 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:28.014009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:28.022041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb292e1-50e7-4a49-8070-38e611ff2309 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:28.057862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4c756-edac-4cbd-8abf-9cf8c76e8f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:28.058483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4c756-edac-4cbd-8abf-9cf8c76e8f30 None admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:28.058756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4c756-edac-4cbd-8abf-9cf8c76e8f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:28.059029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4c756-edac-4cbd-8abf-9cf8c76e8f30 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:28.059614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4c756-edac-4cbd-8abf-9cf8c76e8f30 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:28.061021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4c756-edac-4cbd-8abf-9cf8c76e8f30 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application [None req-e3a4c756-edac-4cbd-8abf-9cf8c76e8f30 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:17:28.070627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:17:28.071786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application with Lock( Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: ERROR keystone.server.flask.application Sep 16 19:17:28.072897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 640/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Sep 16 19:17:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:17:28.078528 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fbb5f-c6ce-457e-ba5b-dec674d6abb0 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:28.176338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:28.206757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fbb5f-c6ce-457e-ba5b-dec674d6abb0 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:28.243946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf93dca-3a27-4f1d-b89b-3bfbc8747ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:28.244594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf93dca-3a27-4f1d-b89b-3bfbc8747ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:28.244871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf93dca-3a27-4f1d-b89b-3bfbc8747ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:28.245129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf93dca-3a27-4f1d-b89b-3bfbc8747ca9 None admin] PATH_INFO: `/v3/services` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:28.245762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf93dca-3a27-4f1d-b89b-3bfbc8747ca9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:17:28.246064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf93dca-3a27-4f1d-b89b-3bfbc8747ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:28.247446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf93dca-3a27-4f1d-b89b-3bfbc8747ca9 None admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:28.252852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 665/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Sep 16 19:17:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:17:28.259004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4c756-edac-4cbd-8abf-9cf8c76e8f30 None admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:17:28.359647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4c756-edac-4cbd-8abf-9cf8c76e8f30 None admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:17:28.394645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c168b17-b754-438c-b75d-75f1b5b4a838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:17:28.395311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168b17-b754-438c-b75d-75f1b5b4a838 None admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:17:28.395594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168b17-b754-438c-b75d-75f1b5b4a838 None admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:17:28.395862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168b17-b754-438c-b75d-75f1b5b4a838 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:17:28.396555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c168b17-b754-438c-b75d-75f1b5b4a838 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:17:28.397918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c168b17-b754-438c-b75d-75f1b5b4a838 None admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:17:28.427726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 641/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:17:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:17:38.249723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=30 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:38.418650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:33.231199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094d00-8d9d-4e11-ab3c-9f7a96681836 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:33.231698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094d00-8d9d-4e11-ab3c-9f7a96681836 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:33.231794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094d00-8d9d-4e11-ab3c-9f7a96681836 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:33.236792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 666/1307] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:18:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:33.239172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b48d08-c79a-4de3-9e20-006ae8227453 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:33.239618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b48d08-c79a-4de3-9e20-006ae8227453 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:33.239843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b48d08-c79a-4de3-9e20-006ae8227453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:33.351889 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-a9b48d08-c79a-4de3-9e20-006ae8227453 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:33.353221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a9b48d08-c79a-4de3-9e20-006ae8227453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:33.503642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 642/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:33.798890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbbb05-6790-4a9a-9bea-e15734e77d93 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:33.799146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbbb05-6790-4a9a-9bea-e15734e77d93 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:33.799388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbbb05-6790-4a9a-9bea-e15734e77d93 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:33.801153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 667/1309] 10.222.0.49 () {54 vars in 963 bytes} [Fri Sep 16 19:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:33.807915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f269ce6-3562-49f1-8e64-82f5ced75fc8 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:33.808193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f269ce6-3562-49f1-8e64-82f5ced75fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:33.808474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f269ce6-3562-49f1-8e64-82f5ced75fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:33.902733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2f269ce6-3562-49f1-8e64-82f5ced75fc8 None None] MFA Rules not processed for user `32ca32d96f9a436782ef0680f6b5dcac`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:33.904160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2f269ce6-3562-49f1-8e64-82f5ced75fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:33.928174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:33.991217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 643/1310] 10.222.0.49 () {58 vars in 1060 bytes} [Fri Sep 16 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:34.000509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbbb05-6790-4a9a-9bea-e15734e77d93 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:34.002530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-fdfbbb05-6790-4a9a-9bea-e15734e77d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:34.118522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbbb05-6790-4a9a-9bea-e15734e77d93 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:34.197688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5d115-80bb-497d-83a3-6b911fbeb8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:34.198304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5d115-80bb-497d-83a3-6b911fbeb8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:34.198635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5d115-80bb-497d-83a3-6b911fbeb8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:34.198882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5d115-80bb-497d-83a3-6b911fbeb8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:34.200570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f2d5d115-80bb-497d-83a3-6b911fbeb8c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:34.258952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:34.331265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5d115-80bb-497d-83a3-6b911fbeb8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:34.333079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5d115-80bb-497d-83a3-6b911fbeb8c1 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:34.355679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 668/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:36.846691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba95a1f-a38b-4e44-968f-112331c71658 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:36.847238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba95a1f-a38b-4e44-968f-112331c71658 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:36.847238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba95a1f-a38b-4e44-968f-112331c71658 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:36.848552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 644/1312] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:36.853911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8b41f-5d97-4044-9278-8baa4001ed8c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:36.854331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8b41f-5d97-4044-9278-8baa4001ed8c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:36.854443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8b41f-5d97-4044-9278-8baa4001ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:36.939792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-84f8b41f-5d97-4044-9278-8baa4001ed8c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:36.941028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-84f8b41f-5d97-4044-9278-8baa4001ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:37.040477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 669/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:37.341572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999380-347d-42d1-8ed1-e7accf0e4108 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:37.341859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999380-347d-42d1-8ed1-e7accf0e4108 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:37.342136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999380-347d-42d1-8ed1-e7accf0e4108 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:37.344024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 645/1314] 10.222.0.49 () {54 vars in 963 bytes} [Fri Sep 16 19:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:37.351634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70691c86-85d7-4a82-bfcc-07e0018d16ee None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:37.351917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70691c86-85d7-4a82-bfcc-07e0018d16ee None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:37.352187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70691c86-85d7-4a82-bfcc-07e0018d16ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:37.367196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:37.435382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-70691c86-85d7-4a82-bfcc-07e0018d16ee None None] MFA Rules not processed for user `32ca32d96f9a436782ef0680f6b5dcac`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:37.436642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-70691c86-85d7-4a82-bfcc-07e0018d16ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:37.515263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 670/1315] 10.222.0.49 () {58 vars in 1060 bytes} [Fri Sep 16 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:37.524543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97999380-347d-42d1-8ed1-e7accf0e4108 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:37.526086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-97999380-347d-42d1-8ed1-e7accf0e4108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:37.646056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97999380-347d-42d1-8ed1-e7accf0e4108 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:37.740243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:37.743198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfac6fb-d9e7-4074-b732-1bc168d94589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:37.743817 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfac6fb-d9e7-4074-b732-1bc168d94589 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:37.744097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfac6fb-d9e7-4074-b732-1bc168d94589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:37.744374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfac6fb-d9e7-4074-b732-1bc168d94589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:37.747079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7bfac6fb-d9e7-4074-b732-1bc168d94589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:37.860429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfac6fb-d9e7-4074-b732-1bc168d94589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:37.861959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfac6fb-d9e7-4074-b732-1bc168d94589 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:37.883154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 646/1316] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:40.654608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f5042-d29a-47d0-9d33-fe85dd4775cd None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:40.655478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f5042-d29a-47d0-9d33-fe85dd4775cd None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:40.656080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f5042-d29a-47d0-9d33-fe85dd4775cd None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:40.658978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 671/1317] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:18:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:40.665872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad13c-dc64-41ac-b38e-8dfd8fb4bf8f None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:40.666344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad13c-dc64-41ac-b38e-8dfd8fb4bf8f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:40.666462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad13c-dc64-41ac-b38e-8dfd8fb4bf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:40.744692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f0cad13c-dc64-41ac-b38e-8dfd8fb4bf8f None None] MFA Rules not processed for user `c60ac1ea012749b8837fa25f6f407f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:40.745899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f0cad13c-dc64-41ac-b38e-8dfd8fb4bf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:40.804050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:40.862607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 647/1318] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:41.145687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f5042-d29a-47d0-9d33-fe85dd4775cd None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:41.148211 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4e5f5042-d29a-47d0-9d33-fe85dd4775cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:41.261340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f5042-d29a-47d0-9d33-fe85dd4775cd None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:41.264088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:41.342241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9ae7c-a368-4aaa-a7b4-e19eb6da30aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:41.342849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ae7c-a368-4aaa-a7b4-e19eb6da30aa service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:41.343119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ae7c-a368-4aaa-a7b4-e19eb6da30aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:41.343394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ae7c-a368-4aaa-a7b4-e19eb6da30aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:41.345174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6ee9ae7c-a368-4aaa-a7b4-e19eb6da30aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:41.472498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ae7c-a368-4aaa-a7b4-e19eb6da30aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:41.473915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ae7c-a368-4aaa-a7b4-e19eb6da30aa service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:41.493741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 672/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:44.261430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd68b2-9696-4b40-8037-bdb09545b435 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.262306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd68b2-9696-4b40-8037-bdb09545b435 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.262306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd68b2-9696-4b40-8037-bdb09545b435 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.264493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 648/1320] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:18:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:44.273435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea326-7ac4-41e8-92d4-93e047c0aa94 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.273866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea326-7ac4-41e8-92d4-93e047c0aa94 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.273996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea326-7ac4-41e8-92d4-93e047c0aa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.320232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:44.347817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-29aea326-7ac4-41e8-92d4-93e047c0aa94 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:44.349056 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-29aea326-7ac4-41e8-92d4-93e047c0aa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:44.452409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 673/1321] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:18:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:44.734469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd68b2-9696-4b40-8037-bdb09545b435 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:44.736265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2cdd68b2-9696-4b40-8037-bdb09545b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:44.846854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd68b2-9696-4b40-8037-bdb09545b435 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:44.928560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda6244-25e1-4a2b-98e2-a427c7adfa10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:44.929167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda6244-25e1-4a2b-98e2-a427c7adfa10 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.929439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda6244-25e1-4a2b-98e2-a427c7adfa10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.929707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda6244-25e1-4a2b-98e2-a427c7adfa10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.931308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-cbda6244-25e1-4a2b-98e2-a427c7adfa10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:44.938768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:45.048250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda6244-25e1-4a2b-98e2-a427c7adfa10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:45.049733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda6244-25e1-4a2b-98e2-a427c7adfa10 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:45.069262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 649/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:47.894606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd224-4908-4886-84a3-6c254ba8eba6 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:47.895170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd224-4908-4886-84a3-6c254ba8eba6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:47.895170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd224-4908-4886-84a3-6c254ba8eba6 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:47.896521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 674/1323] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:47.902076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08003-0048-4ba1-939a-7b297a4c7561 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:47.902509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08003-0048-4ba1-939a-7b297a4c7561 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:47.902606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08003-0048-4ba1-939a-7b297a4c7561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:47.979551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6fd08003-0048-4ba1-939a-7b297a4c7561 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:47.980817 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6fd08003-0048-4ba1-939a-7b297a4c7561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:48.046953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:48.089936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 650/1324] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:48.368277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fd224-4908-4886-84a3-6c254ba8eba6 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:48.369862 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-db2fd224-4908-4886-84a3-6c254ba8eba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:48.480212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fd224-4908-4886-84a3-6c254ba8eba6 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:48.494208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:48.558136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641775b-9c4a-42ec-901d-9fe2efc5d317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:48.558735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641775b-9c4a-42ec-901d-9fe2efc5d317 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.559033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641775b-9c4a-42ec-901d-9fe2efc5d317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.559305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641775b-9c4a-42ec-901d-9fe2efc5d317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.560972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e641775b-9c4a-42ec-901d-9fe2efc5d317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:48.675420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641775b-9c4a-42ec-901d-9fe2efc5d317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:48.677156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641775b-9c4a-42ec-901d-9fe2efc5d317 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:48.695804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 675/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:50.882541 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804969f-7e49-4d4f-888e-23cf71b84bf7 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:50.883141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804969f-7e49-4d4f-888e-23cf71b84bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:50.883141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804969f-7e49-4d4f-888e-23cf71b84bf7 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:50.884700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 651/1326] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:50.889809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f301a2f-9095-475d-8b91-e1c220b079a4 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:50.890233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f301a2f-9095-475d-8b91-e1c220b079a4 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:50.890349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f301a2f-9095-475d-8b91-e1c220b079a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:50.939276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:50.960246 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5f301a2f-9095-475d-8b91-e1c220b079a4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:50.961411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5f301a2f-9095-475d-8b91-e1c220b079a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:51.064469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 676/1327] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:51.367384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804969f-7e49-4d4f-888e-23cf71b84bf7 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:51.368958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-1804969f-7e49-4d4f-888e-23cf71b84bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:51.475618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804969f-7e49-4d4f-888e-23cf71b84bf7 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:51.558556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb0657-0c8b-40a8-8808-6ad1ce7de395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:51.559428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0657-0c8b-40a8-8808-6ad1ce7de395 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:51.559829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0657-0c8b-40a8-8808-6ad1ce7de395 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:51.560219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0657-0c8b-40a8-8808-6ad1ce7de395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:51.562681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-bbfb0657-0c8b-40a8-8808-6ad1ce7de395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:51.589063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:51.686181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb0657-0c8b-40a8-8808-6ad1ce7de395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:51.687715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb0657-0c8b-40a8-8808-6ad1ce7de395 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:51.706014 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 652/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:53.971299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16927-72c5-4b37-9a99-29b67d0bc1ea None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:53.971829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16927-72c5-4b37-9a99-29b67d0bc1ea None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:53.971922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16927-72c5-4b37-9a99-29b67d0bc1ea None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:53.973530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 677/1329] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:53.978961 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e925b-cd3d-475a-a674-26fca6133339 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:53.979387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e925b-cd3d-475a-a674-26fca6133339 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:53.979597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e925b-cd3d-475a-a674-26fca6133339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:54.046781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-b93e925b-cd3d-475a-a674-26fca6133339 None None] MFA Rules not processed for user `c60ac1ea012749b8837fa25f6f407f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:54.048038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b93e925b-cd3d-475a-a674-26fca6133339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:54.126413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:54.166104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 653/1330] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:54.446912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd16927-72c5-4b37-9a99-29b67d0bc1ea None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:54.448440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-dcd16927-72c5-4b37-9a99-29b67d0bc1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:54.553549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd16927-72c5-4b37-9a99-29b67d0bc1ea None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:54.575111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:54.627732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015677-4172-439c-a049-0e4d07b6d038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:54.628338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015677-4172-439c-a049-0e4d07b6d038 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:54.628648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015677-4172-439c-a049-0e4d07b6d038 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:54.628906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015677-4172-439c-a049-0e4d07b6d038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:54.630478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7a015677-4172-439c-a049-0e4d07b6d038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:54.742232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015677-4172-439c-a049-0e4d07b6d038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:54.743592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015677-4172-439c-a049-0e4d07b6d038 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:54.765678 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 678/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:57.186640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb242a-a428-44fa-adf1-6268607fd662 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:57.187797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb242a-a428-44fa-adf1-6268607fd662 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:57.187797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb242a-a428-44fa-adf1-6268607fd662 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:57.189694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 654/1332] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:18:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:57.202980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95127d51-bf1d-41b9-b172-c87d6c09a8e2 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:57.203859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95127d51-bf1d-41b9-b172-c87d6c09a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:57.204146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95127d51-bf1d-41b9-b172-c87d6c09a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:57.279237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:57.282310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-95127d51-bf1d-41b9-b172-c87d6c09a8e2 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:57.284627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-95127d51-bf1d-41b9-b172-c87d6c09a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:57.391428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 679/1333] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:57.674920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb242a-a428-44fa-adf1-6268607fd662 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:57.676944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d7bb242a-a428-44fa-adf1-6268607fd662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:57.795295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb242a-a428-44fa-adf1-6268607fd662 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:57.871343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5193e1e-7947-4d24-b448-fd194b9c696d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:57.871943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5193e1e-7947-4d24-b448-fd194b9c696d service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:57.872214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5193e1e-7947-4d24-b448-fd194b9c696d service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:57.872520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5193e1e-7947-4d24-b448-fd194b9c696d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:57.874087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e5193e1e-7947-4d24-b448-fd194b9c696d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:57.900992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:57.987394 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5193e1e-7947-4d24-b448-fd194b9c696d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:57.988782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5193e1e-7947-4d24-b448-fd194b9c696d service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:58.012079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 655/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:00.206711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd685-327d-4e9c-aec3-6ba415684bb2 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.207279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd685-327d-4e9c-aec3-6ba415684bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.207279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd685-327d-4e9c-aec3-6ba415684bb2 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.208558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 680/1335] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:00.214815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90352d52-8ffa-4ec6-8fe6-6982c0aac998 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.215266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90352d52-8ffa-4ec6-8fe6-6982c0aac998 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.215421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90352d52-8ffa-4ec6-8fe6-6982c0aac998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.296410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-90352d52-8ffa-4ec6-8fe6-6982c0aac998 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:00.297618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-90352d52-8ffa-4ec6-8fe6-6982c0aac998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:00.380333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:00.404732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 656/1336] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:00.699594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd685-327d-4e9c-aec3-6ba415684bb2 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:00.701172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-33fbd685-327d-4e9c-aec3-6ba415684bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:00.813030 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd685-327d-4e9c-aec3-6ba415684bb2 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:00.842432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:00.894376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dba8b5-0363-4995-8da2-c303535b2835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:00.894989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dba8b5-0363-4995-8da2-c303535b2835 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.895261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dba8b5-0363-4995-8da2-c303535b2835 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.895528 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dba8b5-0363-4995-8da2-c303535b2835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.897164 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-04dba8b5-0363-4995-8da2-c303535b2835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:01.016869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dba8b5-0363-4995-8da2-c303535b2835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:01.018287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dba8b5-0363-4995-8da2-c303535b2835 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:01.036952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 681/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:03.829000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d774b9-d11e-4941-96d9-465f9d09273d None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:03.829527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d774b9-d11e-4941-96d9-465f9d09273d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:03.829527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d774b9-d11e-4941-96d9-465f9d09273d None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:03.831364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 657/1338] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:03.839829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d9ec1-7e32-4f6a-8f15-16242e5f6ab2 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:03.840301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d9ec1-7e32-4f6a-8f15-16242e5f6ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:03.840457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d9ec1-7e32-4f6a-8f15-16242e5f6ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:03.915888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0f9d9ec1-7e32-4f6a-8f15-16242e5f6ab2 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:03.917170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0f9d9ec1-7e32-4f6a-8f15-16242e5f6ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:03.926492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:04.029656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 682/1339] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:04.315096 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d774b9-d11e-4941-96d9-465f9d09273d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:04.317606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d6d774b9-d11e-4941-96d9-465f9d09273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:04.451376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d774b9-d11e-4941-96d9-465f9d09273d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:04.534200 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d7d5c-e93d-4a8b-a754-6c68be1fbc62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:04.534803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7d5c-e93d-4a8b-a754-6c68be1fbc62 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:04.535078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7d5c-e93d-4a8b-a754-6c68be1fbc62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:04.535344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7d5c-e93d-4a8b-a754-6c68be1fbc62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:04.536970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-896d7d5c-e93d-4a8b-a754-6c68be1fbc62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:04.581926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:04.683953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d7d5c-e93d-4a8b-a754-6c68be1fbc62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:04.685436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d7d5c-e93d-4a8b-a754-6c68be1fbc62 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:04.705169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 658/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:09.054606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5388ad1-7245-4298-8814-d38a363f322c None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.055076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5388ad1-7245-4298-8814-d38a363f322c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.055277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5388ad1-7245-4298-8814-d38a363f322c None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.056734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 683/1341] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:09.062926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee15444-6682-4226-a1ef-352205193599 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.063398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee15444-6682-4226-a1ef-352205193599 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.063726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee15444-6682-4226-a1ef-352205193599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.139044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-8ee15444-6682-4226-a1ef-352205193599 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:09.141445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8ee15444-6682-4226-a1ef-352205193599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:09.240101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:09.252628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 659/1342] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:09.533765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5388ad1-7245-4298-8814-d38a363f322c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.535305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a5388ad1-7245-4298-8814-d38a363f322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:09.646232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5388ad1-7245-4298-8814-d38a363f322c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:09.685684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:09.723190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce11196-aec0-4a67-b9f4-ea4cfe2d52e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.723815 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11196-aec0-4a67-b9f4-ea4cfe2d52e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.724093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11196-aec0-4a67-b9f4-ea4cfe2d52e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.724365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11196-aec0-4a67-b9f4-ea4cfe2d52e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.725975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0ce11196-aec0-4a67-b9f4-ea4cfe2d52e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:09.841221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce11196-aec0-4a67-b9f4-ea4cfe2d52e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.842987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce11196-aec0-4a67-b9f4-ea4cfe2d52e6 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.862806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 684/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:12.604824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245ab91-35e6-4116-bc39-e6356e103c3d None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:12.605397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245ab91-35e6-4116-bc39-e6356e103c3d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:12.605397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245ab91-35e6-4116-bc39-e6356e103c3d None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:12.606717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 660/1344] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:12.612465 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978bf06-979e-4749-b9bf-d51d94099f27 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:12.612918 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978bf06-979e-4749-b9bf-d51d94099f27 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:12.613041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978bf06-979e-4749-b9bf-d51d94099f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:12.681560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f978bf06-979e-4749-b9bf-d51d94099f27 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:12.682780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f978bf06-979e-4749-b9bf-d51d94099f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:12.702039 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:12.789375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 685/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:13.072001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245ab91-35e6-4116-bc39-e6356e103c3d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:13.073591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9245ab91-35e6-4116-bc39-e6356e103c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:13.186427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245ab91-35e6-4116-bc39-e6356e103c3d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:13.264637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29015432-df05-44fb-8e52-417012683e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:13.265250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29015432-df05-44fb-8e52-417012683e8d service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:13.265526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29015432-df05-44fb-8e52-417012683e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:13.265828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29015432-df05-44fb-8e52-417012683e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:13.267456 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-29015432-df05-44fb-8e52-417012683e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:13.313884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:13.385580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29015432-df05-44fb-8e52-417012683e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:13.386985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29015432-df05-44fb-8e52-417012683e8d service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:13.407164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 661/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:17.849299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7dc60-31c5-44b6-a150-7ee4874b8f8a None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:17.849299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7dc60-31c5-44b6-a150-7ee4874b8f8a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:17.849816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7dc60-31c5-44b6-a150-7ee4874b8f8a None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:17.850955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 686/1347] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:17.856571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89dfea-9e6b-4f39-93f9-fffc8431f3ad None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:17.857003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89dfea-9e6b-4f39-93f9-fffc8431f3ad None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:17.857207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89dfea-9e6b-4f39-93f9-fffc8431f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:17.925849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6c89dfea-9e6b-4f39-93f9-fffc8431f3ad None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:17.927063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6c89dfea-9e6b-4f39-93f9-fffc8431f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:18.028586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:18.031444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 662/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:18.318291 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7dc60-31c5-44b6-a150-7ee4874b8f8a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:18.321334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-87b7dc60-31c5-44b6-a150-7ee4874b8f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:18.433933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7dc60-31c5-44b6-a150-7ee4874b8f8a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:18.495094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:18.522834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c93f6c-c9b1-4916-ad8d-11b8e9f2c103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:18.523434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93f6c-c9b1-4916-ad8d-11b8e9f2c103 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:18.523701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93f6c-c9b1-4916-ad8d-11b8e9f2c103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:18.523962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93f6c-c9b1-4916-ad8d-11b8e9f2c103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:18.525586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f3c93f6c-c9b1-4916-ad8d-11b8e9f2c103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:18.638917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c93f6c-c9b1-4916-ad8d-11b8e9f2c103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:18.640277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c93f6c-c9b1-4916-ad8d-11b8e9f2c103 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:18.659293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 687/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:23.590432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2966fe0-0329-4033-8b9d-0ecb16e87160 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:23.590904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2966fe0-0329-4033-8b9d-0ecb16e87160 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:23.591087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2966fe0-0329-4033-8b9d-0ecb16e87160 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:23.592651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 663/1350] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:23.602628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57856-bdbc-45c4-aba2-d98e75c70c58 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:23.602628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57856-bdbc-45c4-aba2-d98e75c70c58 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:23.602628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57856-bdbc-45c4-aba2-d98e75c70c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:23.693274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-18f57856-bdbc-45c4-aba2-d98e75c70c58 None None] MFA Rules not processed for user `d09ca68fdd5b4e178bcd6a5c8bccc4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:23.694717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-18f57856-bdbc-45c4-aba2-d98e75c70c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:23.715151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:23.863983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 688/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:28.005215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592a352-1175-4ae1-8376-455fe69315c7 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:28.005800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592a352-1175-4ae1-8376-455fe69315c7 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:28.005800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592a352-1175-4ae1-8376-455fe69315c7 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:28.007114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 664/1352] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:28.012676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c14cef-3e85-486f-9454-bb365396a3ef None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:28.013289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c14cef-3e85-486f-9454-bb365396a3ef None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:28.013632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c14cef-3e85-486f-9454-bb365396a3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:28.102469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-75c14cef-3e85-486f-9454-bb365396a3ef None None] MFA Rules not processed for user `d09ca68fdd5b4e178bcd6a5c8bccc4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:28.103582 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-75c14cef-3e85-486f-9454-bb365396a3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:28.185932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:28.228836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 689/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:19:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:29.656993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78dd92-2a81-4105-aae1-93738a6e326e None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.657620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78dd92-2a81-4105-aae1-93738a6e326e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.657620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78dd92-2a81-4105-aae1-93738a6e326e None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.659065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 665/1354] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:29.664135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ccb5-1556-4cc6-870e-0286ce7821fe None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.664635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ccb5-1556-4cc6-870e-0286ce7821fe None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.664792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ccb5-1556-4cc6-870e-0286ce7821fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.746387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0939ccb5-1556-4cc6-870e-0286ce7821fe None None] MFA Rules not processed for user `d09ca68fdd5b4e178bcd6a5c8bccc4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:29.747614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0939ccb5-1556-4cc6-870e-0286ce7821fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:29.863762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 690/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:33.387344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ff755-a914-4884-b733-207dade6d793 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.387904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ff755-a914-4884-b733-207dade6d793 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.387904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ff755-a914-4884-b733-207dade6d793 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.389309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 666/1356] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:33.394760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64f6f3-5af1-433e-ae82-b64a0a161d7e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.395183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64f6f3-5af1-433e-ae82-b64a0a161d7e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.395351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64f6f3-5af1-433e-ae82-b64a0a161d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.433376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:33.470930 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4f64f6f3-5af1-433e-ae82-b64a0a161d7e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:33.472118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4f64f6f3-5af1-433e-ae82-b64a0a161d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:33.578296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 691/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:33.876634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3936ca-d6e2-4d78-ae35-1f0109c8f867 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.877059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3936ca-d6e2-4d78-ae35-1f0109c8f867 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.877717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3936ca-d6e2-4d78-ae35-1f0109c8f867 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.880320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 667/1358] 10.222.0.49 () {54 vars in 965 bytes} [Fri Sep 16 19:19:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:33.890962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97204168-cda1-4f26-91bf-dc23833fc353 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.891522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97204168-cda1-4f26-91bf-dc23833fc353 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.892472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97204168-cda1-4f26-91bf-dc23833fc353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.973985 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-97204168-cda1-4f26-91bf-dc23833fc353 None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:33.975204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-97204168-cda1-4f26-91bf-dc23833fc353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:34.025737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:34.098213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 692/1359] 10.222.0.49 () {58 vars in 1062 bytes} [Fri Sep 16 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:34.106433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3936ca-d6e2-4d78-ae35-1f0109c8f867 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:34.107971 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3c3936ca-d6e2-4d78-ae35-1f0109c8f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:34.257838 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3936ca-d6e2-4d78-ae35-1f0109c8f867 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:34.340311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:34.383615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59409f-8d15-4f9b-b73f-11efd0508297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:34.384150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59409f-8d15-4f9b-b73f-11efd0508297 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.384431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59409f-8d15-4f9b-b73f-11efd0508297 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.384701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59409f-8d15-4f9b-b73f-11efd0508297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.386331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8a59409f-8d15-4f9b-b73f-11efd0508297 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:34.484627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59409f-8d15-4f9b-b73f-11efd0508297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:34.486261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59409f-8d15-4f9b-b73f-11efd0508297 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:34.507874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 668/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:36.888847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27b028-bc64-4873-ae31-d0718cd1a34f None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:36.889394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27b028-bc64-4873-ae31-d0718cd1a34f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:36.889394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27b028-bc64-4873-ae31-d0718cd1a34f None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:36.890951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 693/1361] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:36.896326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2457ea-b7f9-4cbd-8226-3040fcbfcfd3 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:36.896805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2457ea-b7f9-4cbd-8226-3040fcbfcfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:36.896899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2457ea-b7f9-4cbd-8226-3040fcbfcfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:36.992360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ef2457ea-b7f9-4cbd-8226-3040fcbfcfd3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:36.994920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ef2457ea-b7f9-4cbd-8226-3040fcbfcfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:37.043683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:37.112421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 669/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:37.397248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27b028-bc64-4873-ae31-d0718cd1a34f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:37.398921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-be27b028-bc64-4873-ae31-d0718cd1a34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:37.570298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27b028-bc64-4873-ae31-d0718cd1a34f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:37.584308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:37.725341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00792c6b-1268-475f-9aab-d1c1f6ff2870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:37.726202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00792c6b-1268-475f-9aab-d1c1f6ff2870 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:37.726202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00792c6b-1268-475f-9aab-d1c1f6ff2870 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:37.726202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00792c6b-1268-475f-9aab-d1c1f6ff2870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:37.728961 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-00792c6b-1268-475f-9aab-d1c1f6ff2870 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:37.833599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00792c6b-1268-475f-9aab-d1c1f6ff2870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:37.835595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00792c6b-1268-475f-9aab-d1c1f6ff2870 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:37.854066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 694/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:40.321868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eb738-751b-43c6-b340-a56ac7149455 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:40.322462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eb738-751b-43c6-b340-a56ac7149455 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:40.322462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eb738-751b-43c6-b340-a56ac7149455 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:40.324052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 670/1364] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:40.329795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76c629-56de-42a6-b6ce-d592f2e8431d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:40.330432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76c629-56de-42a6-b6ce-d592f2e8431d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:40.330432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76c629-56de-42a6-b6ce-d592f2e8431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:40.346856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:40.405080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-2a76c629-56de-42a6-b6ce-d592f2e8431d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:40.406373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2a76c629-56de-42a6-b6ce-d592f2e8431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:40.525253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 695/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:40.843102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fff87-91d3-4c6d-9381-e9daf73edc72 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:40.843752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fff87-91d3-4c6d-9381-e9daf73edc72 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:40.844238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fff87-91d3-4c6d-9381-e9daf73edc72 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:40.845972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 671/1366] 10.222.0.49 () {54 vars in 965 bytes} [Fri Sep 16 19:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:40.853831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2905d5-d4a5-4290-8b5a-6b2cf7ba0b3c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:40.854325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2905d5-d4a5-4290-8b5a-6b2cf7ba0b3c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:40.854698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2905d5-d4a5-4290-8b5a-6b2cf7ba0b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:40.948619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-7c2905d5-d4a5-4290-8b5a-6b2cf7ba0b3c None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:40.949940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7c2905d5-d4a5-4290-8b5a-6b2cf7ba0b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:40.994584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:41.096193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 696/1367] 10.222.0.49 () {58 vars in 1062 bytes} [Fri Sep 16 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:41.104351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fff87-91d3-4c6d-9381-e9daf73edc72 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:41.106340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-301fff87-91d3-4c6d-9381-e9daf73edc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:41.320638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fff87-91d3-4c6d-9381-e9daf73edc72 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:41.350841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:41.482466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f1796-a269-4775-8139-603db882bba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:41.483188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f1796-a269-4775-8139-603db882bba0 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.483493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f1796-a269-4775-8139-603db882bba0 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.483759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f1796-a269-4775-8139-603db882bba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.485413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f88f1796-a269-4775-8139-603db882bba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:41.598280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f1796-a269-4775-8139-603db882bba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:41.600187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f1796-a269-4775-8139-603db882bba0 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:41.624101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 672/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:41.704505 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d2b9-8ed7-4b15-b121-7f89be759c4b None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.705110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d2b9-8ed7-4b15-b121-7f89be759c4b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.705110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d2b9-8ed7-4b15-b121-7f89be759c4b None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.706546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 697/1369] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:41.711984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c89888-5ece-46d3-be40-dd63d18b43a7 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.712275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c89888-5ece-46d3-be40-dd63d18b43a7 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.712583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c89888-5ece-46d3-be40-dd63d18b43a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.760077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:41.810662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-69c89888-5ece-46d3-be40-dd63d18b43a7 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:41.811890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-69c89888-5ece-46d3-be40-dd63d18b43a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:41.932588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 673/1370] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:42.263732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f2f3-bbb7-4c6a-9117-9610bfe6ab91 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:42.263732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f2f3-bbb7-4c6a-9117-9610bfe6ab91 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:42.263732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f2f3-bbb7-4c6a-9117-9610bfe6ab91 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:42.265089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 698/1371] 10.222.0.49 () {54 vars in 964 bytes} [Fri Sep 16 19:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:42.270186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bbf60-487e-4dfa-9c2d-b989926947e2 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:42.270575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bbf60-487e-4dfa-9c2d-b989926947e2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:42.270978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bbf60-487e-4dfa-9c2d-b989926947e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:42.361557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ea9bbf60-487e-4dfa-9c2d-b989926947e2 None None] MFA Rules not processed for user `f932b95e90774030b003f554d9f90481`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:42.362846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ea9bbf60-487e-4dfa-9c2d-b989926947e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:42.417549 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:42.453131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 674/1372] 10.222.0.49 () {58 vars in 1061 bytes} [Fri Sep 16 19:19:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:42.460977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575f2f3-bbb7-4c6a-9117-9610bfe6ab91 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:42.462780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5575f2f3-bbb7-4c6a-9117-9610bfe6ab91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:42.599803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575f2f3-bbb7-4c6a-9117-9610bfe6ab91 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:42.677363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:42.728900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e37f1a-81ac-45b1-bb64-bc0fe6700381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:42.729599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e37f1a-81ac-45b1-bb64-bc0fe6700381 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:42.730160 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e37f1a-81ac-45b1-bb64-bc0fe6700381 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:42.730556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e37f1a-81ac-45b1-bb64-bc0fe6700381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:42.732819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-43e37f1a-81ac-45b1-bb64-bc0fe6700381 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:42.889017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e37f1a-81ac-45b1-bb64-bc0fe6700381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:42.890548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e37f1a-81ac-45b1-bb64-bc0fe6700381 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:42.912410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 699/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:43.872192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8bbc-fda3-4541-b268-2e7d609b0bb2 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:43.872788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8bbc-fda3-4541-b268-2e7d609b0bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:43.872788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8bbc-fda3-4541-b268-2e7d609b0bb2 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:43.874032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 675/1374] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:43.879487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854ec12-e972-49c0-9545-6b2d078fa7ac None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:43.879935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854ec12-e972-49c0-9545-6b2d078fa7ac None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:43.880033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854ec12-e972-49c0-9545-6b2d078fa7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:43.949046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4854ec12-e972-49c0-9545-6b2d078fa7ac None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:43.950275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4854ec12-e972-49c0-9545-6b2d078fa7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:43.971575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:44.049120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 700/1375] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:44.334817 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc8bbc-fda3-4541-b268-2e7d609b0bb2 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:44.336417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4dbc8bbc-fda3-4541-b268-2e7d609b0bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:44.503476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc8bbc-fda3-4541-b268-2e7d609b0bb2 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:44.566385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:44.632119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83449a7-00c3-43cb-8859-83410af577f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:44.632786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83449a7-00c3-43cb-8859-83410af577f6 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:44.633076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83449a7-00c3-43cb-8859-83410af577f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:44.633336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83449a7-00c3-43cb-8859-83410af577f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:44.634937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a83449a7-00c3-43cb-8859-83410af577f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:44.728658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83449a7-00c3-43cb-8859-83410af577f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:44.730610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83449a7-00c3-43cb-8859-83410af577f6 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:44.749438 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 676/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:46.985273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516a84-02fb-4521-8561-26c6da1a2a80 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:46.985825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516a84-02fb-4521-8561-26c6da1a2a80 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:46.985825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516a84-02fb-4521-8561-26c6da1a2a80 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:46.987198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 701/1377] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:46.992806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84e423-382e-48de-be06-ea42c077681e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:46.993300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84e423-382e-48de-be06-ea42c077681e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:46.993408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84e423-382e-48de-be06-ea42c077681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:47.063886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-fb84e423-382e-48de-be06-ea42c077681e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:47.065021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-fb84e423-382e-48de-be06-ea42c077681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:47.072211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:47.177279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 677/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:47.472222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac516a84-02fb-4521-8561-26c6da1a2a80 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:47.473888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ac516a84-02fb-4521-8561-26c6da1a2a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:47.626001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac516a84-02fb-4521-8561-26c6da1a2a80 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:47.629531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:47.741506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad38ee-544c-41fc-9986-9b048ddfd698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:47.742123 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad38ee-544c-41fc-9986-9b048ddfd698 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:47.742384 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad38ee-544c-41fc-9986-9b048ddfd698 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:47.742669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad38ee-544c-41fc-9986-9b048ddfd698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:47.744237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-78ad38ee-544c-41fc-9986-9b048ddfd698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:47.848993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad38ee-544c-41fc-9986-9b048ddfd698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:47.851005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad38ee-544c-41fc-9986-9b048ddfd698 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:47.871034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 702/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:50.080924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a464-6862-4190-9be8-fa9c309fb788 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:50.081487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a464-6862-4190-9be8-fa9c309fb788 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:50.081487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a464-6862-4190-9be8-fa9c309fb788 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:50.082927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 678/1380] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:50.088093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ca25d-5e3e-4843-8c90-c23296fb9b9a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:50.088633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ca25d-5e3e-4843-8c90-c23296fb9b9a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:50.088855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ca25d-5e3e-4843-8c90-c23296fb9b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:50.101121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:50.162144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-e94ca25d-5e3e-4843-8c90-c23296fb9b9a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:50.163349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e94ca25d-5e3e-4843-8c90-c23296fb9b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:50.276627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 703/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:50.566334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6a464-6862-4190-9be8-fa9c309fb788 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:50.568001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6ce6a464-6862-4190-9be8-fa9c309fb788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:50.744050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:50.755615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6a464-6862-4190-9be8-fa9c309fb788 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:50.876177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774ee60-6461-40d2-ab11-ce46760cea60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:50.876827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774ee60-6461-40d2-ab11-ce46760cea60 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:50.877103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774ee60-6461-40d2-ab11-ce46760cea60 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:50.877375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774ee60-6461-40d2-ab11-ce46760cea60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:50.879011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4774ee60-6461-40d2-ab11-ce46760cea60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:50.981266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774ee60-6461-40d2-ab11-ce46760cea60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:50.982927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774ee60-6461-40d2-ab11-ce46760cea60 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:50.996478 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:51.007628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 679/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:53.290527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4d39-7cb7-4fef-b7ea-b5fdc24a2ca3 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:53.291100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4d39-7cb7-4fef-b7ea-b5fdc24a2ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:53.291438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4d39-7cb7-4fef-b7ea-b5fdc24a2ca3 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:53.293396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 704/1383] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:53.300540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d217392-8686-4426-8d84-e25973d601f5 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:53.301007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d217392-8686-4426-8d84-e25973d601f5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:53.301111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d217392-8686-4426-8d84-e25973d601f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:53.375738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-7d217392-8686-4426-8d84-e25973d601f5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:53.377251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7d217392-8686-4426-8d84-e25973d601f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:53.496301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 680/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:53.782227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df4d39-7cb7-4fef-b7ea-b5fdc24a2ca3 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:53.783755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-27df4d39-7cb7-4fef-b7ea-b5fdc24a2ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:53.877582 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:53.945795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df4d39-7cb7-4fef-b7ea-b5fdc24a2ca3 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:54.071143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a406295-83a6-408b-b5e5-19c1ec217296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:54.071742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406295-83a6-408b-b5e5-19c1ec217296 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:54.072018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406295-83a6-408b-b5e5-19c1ec217296 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:54.072311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406295-83a6-408b-b5e5-19c1ec217296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:54.074051 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7a406295-83a6-408b-b5e5-19c1ec217296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:54.129134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:54.172857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a406295-83a6-408b-b5e5-19c1ec217296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:54.174572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a406295-83a6-408b-b5e5-19c1ec217296 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:54.193852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 705/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:56.832266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934fc4-19f4-40c1-b369-2a25e0fe277e None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:56.832870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934fc4-19f4-40c1-b369-2a25e0fe277e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:56.832870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934fc4-19f4-40c1-b369-2a25e0fe277e None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:56.834397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 681/1386] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:56.840777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a199d74-21e4-45d4-a309-d5b0e9387f6f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:56.841295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a199d74-21e4-45d4-a309-d5b0e9387f6f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:56.841393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a199d74-21e4-45d4-a309-d5b0e9387f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:56.910591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8a199d74-21e4-45d4-a309-d5b0e9387f6f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:56.911860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8a199d74-21e4-45d4-a309-d5b0e9387f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.029125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 706/1387] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:57.320934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81934fc4-19f4-40c1-b369-2a25e0fe277e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:57.322715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-81934fc4-19f4-40c1-b369-2a25e0fe277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.406383 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:57.483417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81934fc4-19f4-40c1-b369-2a25e0fe277e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:57.602821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a53ed-89ff-40a8-9a8a-ce895e385d0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:57.603474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a53ed-89ff-40a8-9a8a-ce895e385d0f service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:57.603833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a53ed-89ff-40a8-9a8a-ce895e385d0f service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:57.604121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a53ed-89ff-40a8-9a8a-ce895e385d0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:57.605752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0b3a53ed-89ff-40a8-9a8a-ce895e385d0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.645587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:57.698184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a53ed-89ff-40a8-9a8a-ce895e385d0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:57.699799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a53ed-89ff-40a8-9a8a-ce895e385d0f service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:57.718098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 682/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:58.122884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b98c9-834e-4f3d-a12b-3b867bde7dc9 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.123488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b98c9-834e-4f3d-a12b-3b867bde7dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.123488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b98c9-834e-4f3d-a12b-3b867bde7dc9 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.124889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 707/1389] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:58.130306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289daf70-9610-4c45-a693-fc2fe464db84 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.130798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289daf70-9610-4c45-a693-fc2fe464db84 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.130798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289daf70-9610-4c45-a693-fc2fe464db84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.201720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-289daf70-9610-4c45-a693-fc2fe464db84 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:58.202921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-289daf70-9610-4c45-a693-fc2fe464db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:58.314487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 683/1390] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:58.620780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd06a7-7077-46f2-ba65-64cc284020d9 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.621144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd06a7-7077-46f2-ba65-64cc284020d9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.621490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd06a7-7077-46f2-ba65-64cc284020d9 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.622984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 708/1391] 10.222.0.49 () {54 vars in 962 bytes} [Fri Sep 16 19:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:58.629093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c1c1-d077-4b1f-99b3-493a1bc038d2 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.629467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c1c1-d077-4b1f-99b3-493a1bc038d2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.629894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c1c1-d077-4b1f-99b3-493a1bc038d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.647336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:58.709766 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4e04c1c1-d077-4b1f-99b3-493a1bc038d2 None None] MFA Rules not processed for user `7f83a7e0c14541788c92e3d96b839077`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:58.710989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4e04c1c1-d077-4b1f-99b3-493a1bc038d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:58.793888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 684/1392] 10.222.0.49 () {58 vars in 1059 bytes} [Fri Sep 16 19:19:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:58.803564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd06a7-7077-46f2-ba65-64cc284020d9 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.805140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7efd06a7-7077-46f2-ba65-64cc284020d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:58.837518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:58.914160 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd06a7-7077-46f2-ba65-64cc284020d9 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.989367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450a90-98d3-49bf-b880-e247f68d7f72 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f83a7e0c14541788c92e3d96b839077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.989976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450a90-98d3-49bf-b880-e247f68d7f72 service glance] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.990251 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450a90-98d3-49bf-b880-e247f68d7f72 service glance] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.990502 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450a90-98d3-49bf-b880-e247f68d7f72 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.992079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b6450a90-98d3-49bf-b880-e247f68d7f72 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:59.071925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:59.104210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450a90-98d3-49bf-b880-e247f68d7f72 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:59.105727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450a90-98d3-49bf-b880-e247f68d7f72 service glance] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:59.123933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 709/1393] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:59.887057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647df47-5220-4649-8967-fdb71b148459 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:59.887583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647df47-5220-4649-8967-fdb71b148459 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:59.887676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647df47-5220-4649-8967-fdb71b148459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:59.927315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a19c4c-6dd2-4b19-af62-a81b9931f96a None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:59.927659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a19c4c-6dd2-4b19-af62-a81b9931f96a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:59.928005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a19c4c-6dd2-4b19-af62-a81b9931f96a None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:59.929584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 710/1394] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:59.937119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f89f-0b2d-4ea5-9343-6fad4a423106 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:59.937534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f89f-0b2d-4ea5-9343-6fad4a423106 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:59.937976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f89f-0b2d-4ea5-9343-6fad4a423106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:59.983949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-9647df47-5220-4649-8967-fdb71b148459 None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:59.986352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9647df47-5220-4649-8967-fdb71b148459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:00.034024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8ae2f89f-0b2d-4ea5-9343-6fad4a423106 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:00.035270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8ae2f89f-0b2d-4ea5-9343-6fad4a423106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:00.049378 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:00.085149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 685/1395] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:00.137230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be5239-1ef9-489c-8c61-67a0710f0c77 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:00.137597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be5239-1ef9-489c-8c61-67a0710f0c77 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:00.137943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be5239-1ef9-489c-8c61-67a0710f0c77 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:00.140361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 686/1396] 10.222.0.49 () {54 vars in 943 bytes} [Fri Sep 16 19:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:00.144852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 711/1397] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:00.153964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30210c-43c4-4b76-9d1b-e8021a206512 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:00.154597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30210c-43c4-4b76-9d1b-e8021a206512 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:00.155054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30210c-43c4-4b76-9d1b-e8021a206512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:00.239017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4b30210c-43c4-4b76-9d1b-e8021a206512 None None] MFA Rules not processed for user `94828db5fc064a539b5b7b17cac1602b`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:00.240231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4b30210c-43c4-4b76-9d1b-e8021a206512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:00.351831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 687/1398] 10.222.0.49 () {58 vars in 1040 bytes} [Fri Sep 16 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:00.361748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2f89f-0b2d-4ea5-9343-6fad4a423106 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:00.362981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8ae2f89f-0b2d-4ea5-9343-6fad4a423106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:00.404043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:00.447321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30210c-43c4-4b76-9d1b-e8021a206512 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:00.448564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4b30210c-43c4-4b76-9d1b-e8021a206512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:00.473732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2f89f-0b2d-4ea5-9343-6fad4a423106 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:00.481513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:00.551275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30210c-43c4-4b76-9d1b-e8021a206512 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:00.577683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088e449-5669-44d0-bb4c-890bc5c3f890 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:00.578285 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088e449-5669-44d0-bb4c-890bc5c3f890 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:00.578568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088e449-5669-44d0-bb4c-890bc5c3f890 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:00.578837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088e449-5669-44d0-bb4c-890bc5c3f890 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:00.580512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6088e449-5669-44d0-bb4c-890bc5c3f890 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:00.636456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:00.668555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76985a39-073c-4982-b65d-52344bfa3893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:00.668816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088e449-5669-44d0-bb4c-890bc5c3f890 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:00.669171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985a39-073c-4982-b65d-52344bfa3893 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:00.669446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985a39-073c-4982-b65d-52344bfa3893 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:00.669714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985a39-073c-4982-b65d-52344bfa3893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:00.670221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088e449-5669-44d0-bb4c-890bc5c3f890 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:00.671658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-76985a39-073c-4982-b65d-52344bfa3893 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:00.680316 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 712/1399] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:20:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:20:00.719361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:00.781061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76985a39-073c-4982-b65d-52344bfa3893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:00.782970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76985a39-073c-4982-b65d-52344bfa3893 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:00.808107 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 688/1400] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:20:03.034515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81d679-fb8b-48b6-9cff-57f492cdedeb None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:03.035091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81d679-fb8b-48b6-9cff-57f492cdedeb None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:03.035091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81d679-fb8b-48b6-9cff-57f492cdedeb None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:03.036678 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 713/1401] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:03.045194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1653-1d48-40f8-98aa-1b537282c9f3 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:03.046084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1653-1d48-40f8-98aa-1b537282c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:03.046084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1653-1d48-40f8-98aa-1b537282c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:03.116532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-8b5f1653-1d48-40f8-98aa-1b537282c9f3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:03.118123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8b5f1653-1d48-40f8-98aa-1b537282c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:03.227198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 689/1402] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:03.530194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81d679-fb8b-48b6-9cff-57f492cdedeb None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:03.531757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-bc81d679-fb8b-48b6-9cff-57f492cdedeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:03.708102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81d679-fb8b-48b6-9cff-57f492cdedeb None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:03.770531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:03.877715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71306bf9-0d4e-4a90-8faf-ac5815632871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:03.878903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71306bf9-0d4e-4a90-8faf-ac5815632871 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:03.879638 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71306bf9-0d4e-4a90-8faf-ac5815632871 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:03.880213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71306bf9-0d4e-4a90-8faf-ac5815632871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:03.882770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-71306bf9-0d4e-4a90-8faf-ac5815632871 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:03.990818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71306bf9-0d4e-4a90-8faf-ac5815632871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:03.992609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71306bf9-0d4e-4a90-8faf-ac5815632871 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:04.011984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 714/1403] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:06.235778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eebba9-de3f-4784-b342-3ce26af3ca40 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:06.240553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eebba9-de3f-4784-b342-3ce26af3ca40 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:06.240981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eebba9-de3f-4784-b342-3ce26af3ca40 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:06.247331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 690/1404] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:20:06 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:06.249211 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b535f8-53df-434a-9f0e-50ea087bd44b None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:06.250065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b535f8-53df-434a-9f0e-50ea087bd44b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:06.250348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b535f8-53df-434a-9f0e-50ea087bd44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:06.331682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d3b535f8-53df-434a-9f0e-50ea087bd44b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:06.333456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d3b535f8-53df-434a-9f0e-50ea087bd44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:06.336883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:06.451299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 715/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:06.745647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eebba9-de3f-4784-b342-3ce26af3ca40 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:06.747203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e7eebba9-de3f-4784-b342-3ce26af3ca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:06.776600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:06.926167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eebba9-de3f-4784-b342-3ce26af3ca40 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:07.030081 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:07.055896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91ddfa-6b42-4882-a5ea-bbb7c5d89db6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:07.056610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91ddfa-6b42-4882-a5ea-bbb7c5d89db6 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:07.056730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91ddfa-6b42-4882-a5ea-bbb7c5d89db6 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:07.056940 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91ddfa-6b42-4882-a5ea-bbb7c5d89db6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:07.060075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3e91ddfa-6b42-4882-a5ea-bbb7c5d89db6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:07.159990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91ddfa-6b42-4882-a5ea-bbb7c5d89db6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:07.161972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91ddfa-6b42-4882-a5ea-bbb7c5d89db6 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:07.183361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 691/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:09.371295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51703509-d2a7-4f82-b08c-43555e4a0a8e None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:09.372792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51703509-d2a7-4f82-b08c-43555e4a0a8e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:09.373295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51703509-d2a7-4f82-b08c-43555e4a0a8e None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:09.375728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 716/1407] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:20:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:09.382029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01c05-854a-4a8c-9476-143c06ca2eda None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:09.382538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01c05-854a-4a8c-9476-143c06ca2eda None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:09.382752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01c05-854a-4a8c-9476-143c06ca2eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:09.460004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-c4f01c05-854a-4a8c-9476-143c06ca2eda None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:09.461274 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c4f01c05-854a-4a8c-9476-143c06ca2eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:09.522179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:09.572031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 692/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:09.889077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51703509-d2a7-4f82-b08c-43555e4a0a8e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:09.893480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-51703509-d2a7-4f82-b08c-43555e4a0a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:10.041712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:10.054944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51703509-d2a7-4f82-b08c-43555e4a0a8e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:10.176910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93892be-70b6-45f0-9998-e19f1b9fa394 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:10.177519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93892be-70b6-45f0-9998-e19f1b9fa394 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:10.177790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93892be-70b6-45f0-9998-e19f1b9fa394 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:10.178057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93892be-70b6-45f0-9998-e19f1b9fa394 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:10.179687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e93892be-70b6-45f0-9998-e19f1b9fa394 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:10.273888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93892be-70b6-45f0-9998-e19f1b9fa394 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:10.275641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93892be-70b6-45f0-9998-e19f1b9fa394 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:10.287570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:10.298579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 717/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:19.570389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=19 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:20.295457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:23.173871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a94b-91c3-466c-9411-c6cdfa4bdc68 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.174434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a94b-91c3-466c-9411-c6cdfa4bdc68 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.174434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a94b-91c3-466c-9411-c6cdfa4bdc68 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.175689 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 693/1410] 10.222.0.49 () {54 vars in 918 bytes} [Fri Sep 16 19:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:23.181343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd91e-e955-483f-879a-f00dbbe4c1b7 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.181837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd91e-e955-483f-879a-f00dbbe4c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.181945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd91e-e955-483f-879a-f00dbbe4c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.261230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-16edd91e-e955-483f-879a-f00dbbe4c1b7 None None] MFA Rules not processed for user `d09ca68fdd5b4e178bcd6a5c8bccc4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:23.262460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-16edd91e-e955-483f-879a-f00dbbe4c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:23.373253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 718/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Fri Sep 16 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:23.389021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874af7b-d63d-4061-bb99-84a83ac4545e None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.389299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874af7b-d63d-4061-bb99-84a83ac4545e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.389567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874af7b-d63d-4061-bb99-84a83ac4545e None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.390941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 694/1412] 10.222.0.49 () {54 vars in 918 bytes} [Fri Sep 16 19:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:23.396012 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0d11-e578-4010-a30d-5dd857be7f4f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.396296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0d11-e578-4010-a30d-5dd857be7f4f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.396612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0d11-e578-4010-a30d-5dd857be7f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.481618 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:23.485058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f2ab0d11-e578-4010-a30d-5dd857be7f4f None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:23.487062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f2ab0d11-e578-4010-a30d-5dd857be7f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:23.609315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 719/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Fri Sep 16 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:26.218135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b812a6-aefd-4843-9114-a0e8123022d5 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:26.218696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b812a6-aefd-4843-9114-a0e8123022d5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:26.218696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b812a6-aefd-4843-9114-a0e8123022d5 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:26.219984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:26.225835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3665137-c464-429d-a554-17ad02204781 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:26.226421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3665137-c464-429d-a554-17ad02204781 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:26.226421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3665137-c464-429d-a554-17ad02204781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:26.297004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d3665137-c464-429d-a554-17ad02204781 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:26.298231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d3665137-c464-429d-a554-17ad02204781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:26.362001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:26.405845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:26.699215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b812a6-aefd-4843-9114-a0e8123022d5 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:26.700987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-18b812a6-aefd-4843-9114-a0e8123022d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:26.857535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b812a6-aefd-4843-9114-a0e8123022d5 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:26.941235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:26.982833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bc785-a45a-443f-ac3d-9028f54160ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:26.983465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bc785-a45a-443f-ac3d-9028f54160ae service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:26.983745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bc785-a45a-443f-ac3d-9028f54160ae service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:26.984015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bc785-a45a-443f-ac3d-9028f54160ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:26.985656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-dc6bc785-a45a-443f-ac3d-9028f54160ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:27.085151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bc785-a45a-443f-ac3d-9028f54160ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:27.087080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bc785-a45a-443f-ac3d-9028f54160ae service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:27.104758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 696/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:28.259269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f465b1-e3e8-4704-bf07-b06c489f6620 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:28.259840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f465b1-e3e8-4704-bf07-b06c489f6620 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:28.259840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f465b1-e3e8-4704-bf07-b06c489f6620 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:28.261127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:28.267692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bdf96-536e-40f8-bd9a-583b55752945 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:28.268183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bdf96-536e-40f8-bd9a-583b55752945 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:28.268183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bdf96-536e-40f8-bd9a-583b55752945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:28.365082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-7a6bdf96-536e-40f8-bd9a-583b55752945 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:28.366701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7a6bdf96-536e-40f8-bd9a-583b55752945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:28.396402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:28.470108 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:28.621545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f465b1-e3e8-4704-bf07-b06c489f6620 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:28.623861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-34f465b1-e3e8-4704-bf07-b06c489f6620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:28.788737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f465b1-e3e8-4704-bf07-b06c489f6620 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:28.830614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:28.906844 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b27bd-609a-4488-8153-b1523dcb4c62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:28.907381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b27bd-609a-4488-8153-b1523dcb4c62 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:28.907660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b27bd-609a-4488-8153-b1523dcb4c62 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:28.907926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b27bd-609a-4488-8153-b1523dcb4c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:28.909643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-fa3b27bd-609a-4488-8153-b1523dcb4c62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:29.008749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b27bd-609a-4488-8153-b1523dcb4c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:29.010379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b27bd-609a-4488-8153-b1523dcb4c62 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:29.028704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 722/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:30.186455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f621-9d0c-4aef-a169-2228931c9f79 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:30.187015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f621-9d0c-4aef-a169-2228931c9f79 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:30.187015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f621-9d0c-4aef-a169-2228931c9f79 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:30.188251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:30.195934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaf126-acf8-4b17-8ca2-5b364d26b7f7 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:30.196759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaf126-acf8-4b17-8ca2-5b364d26b7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:30.196759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaf126-acf8-4b17-8ca2-5b364d26b7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:30.260476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:30.283939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-b5eaf126-acf8-4b17-8ca2-5b364d26b7f7 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:30.285201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b5eaf126-acf8-4b17-8ca2-5b364d26b7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:30.393093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:30.545878 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594f621-9d0c-4aef-a169-2228931c9f79 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:30.548365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2594f621-9d0c-4aef-a169-2228931c9f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:30.710518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594f621-9d0c-4aef-a169-2228931c9f79 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:30.723627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:30.831426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f1d78-e4b3-437d-ae72-4ab9946f2dea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:30.831957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f1d78-e4b3-437d-ae72-4ab9946f2dea service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:30.832235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f1d78-e4b3-437d-ae72-4ab9946f2dea service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:30.832540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f1d78-e4b3-437d-ae72-4ab9946f2dea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:30.834155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3f9f1d78-e4b3-437d-ae72-4ab9946f2dea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:30.934557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f1d78-e4b3-437d-ae72-4ab9946f2dea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:30.936164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f1d78-e4b3-437d-ae72-4ab9946f2dea service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:30.956056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 699/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:32.070673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb6a8f-a184-496d-bd6a-a8a0dbb45e4d None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:32.071269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb6a8f-a184-496d-bd6a-a8a0dbb45e4d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:32.071269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb6a8f-a184-496d-bd6a-a8a0dbb45e4d None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:32.072700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:32.079490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065d38-6e47-4110-bdfd-c65f664e618c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:32.079978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065d38-6e47-4110-bdfd-c65f664e618c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:32.079978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065d38-6e47-4110-bdfd-c65f664e618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:32.100409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:32.158526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-c9065d38-6e47-4110-bdfd-c65f664e618c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:32.159720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c9065d38-6e47-4110-bdfd-c65f664e618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:32.269335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:32.423124 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb6a8f-a184-496d-bd6a-a8a0dbb45e4d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:32.424490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-47bb6a8f-a184-496d-bd6a-a8a0dbb45e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:32.542213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:32.580053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb6a8f-a184-496d-bd6a-a8a0dbb45e4d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:32.701768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c19fd0-9c05-4306-aa0d-5e8df951ef1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:32.702288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c19fd0-9c05-4306-aa0d-5e8df951ef1b service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:32.702558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c19fd0-9c05-4306-aa0d-5e8df951ef1b service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:32.702829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c19fd0-9c05-4306-aa0d-5e8df951ef1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:32.704425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-86c19fd0-9c05-4306-aa0d-5e8df951ef1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:32.788592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:32.804446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c19fd0-9c05-4306-aa0d-5e8df951ef1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:32.806614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c19fd0-9c05-4306-aa0d-5e8df951ef1b service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:32.825366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 725/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:33.973845 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab21f42-23af-40a9-90dc-386812f38b5f None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:33.974393 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab21f42-23af-40a9-90dc-386812f38b5f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:33.974393 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab21f42-23af-40a9-90dc-386812f38b5f None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:33.975662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:33.982601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dc552-69ea-4c24-9e9d-7aa3ae4466e7 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:33.983116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dc552-69ea-4c24-9e9d-7aa3ae4466e7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:33.983226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dc552-69ea-4c24-9e9d-7aa3ae4466e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:34.072962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-039dc552-69ea-4c24-9e9d-7aa3ae4466e7 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:34.074194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-039dc552-69ea-4c24-9e9d-7aa3ae4466e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:34.177810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:34.327611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab21f42-23af-40a9-90dc-386812f38b5f None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:34.330178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2ab21f42-23af-40a9-90dc-386812f38b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:34.431615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:34.495552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab21f42-23af-40a9-90dc-386812f38b5f None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:34.615674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662dca1-2dd0-45fe-bda1-ba8da04ec4ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:34.616174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662dca1-2dd0-45fe-bda1-ba8da04ec4ac service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:34.616508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662dca1-2dd0-45fe-bda1-ba8da04ec4ac service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:34.616780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662dca1-2dd0-45fe-bda1-ba8da04ec4ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:34.618486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7662dca1-2dd0-45fe-bda1-ba8da04ec4ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:34.668462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:34.715021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662dca1-2dd0-45fe-bda1-ba8da04ec4ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:34.716684 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662dca1-2dd0-45fe-bda1-ba8da04ec4ac service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:34.735291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 702/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:35.838199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08af3e-8e4d-4fb5-bdf9-5bf79db79b4e None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:35.838783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08af3e-8e4d-4fb5-bdf9-5bf79db79b4e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:35.838783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08af3e-8e4d-4fb5-bdf9-5bf79db79b4e None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:35.840117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:35.847775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bcc19-e6d2-46eb-ae99-a0de026e673e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:35.848581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bcc19-e6d2-46eb-ae99-a0de026e673e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:35.848761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bcc19-e6d2-46eb-ae99-a0de026e673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:35.938402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ff3bcc19-e6d2-46eb-ae99-a0de026e673e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:35.939604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ff3bcc19-e6d2-46eb-ae99-a0de026e673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:36.046773 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:36.203368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08af3e-8e4d-4fb5-bdf9-5bf79db79b4e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.204964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4c08af3e-8e4d-4fb5-bdf9-5bf79db79b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:36.255713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:36.357796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08af3e-8e4d-4fb5-bdf9-5bf79db79b4e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.487826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424d780-32e6-4815-8192-a3ae92f76ff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.488472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424d780-32e6-4815-8192-a3ae92f76ff8 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.488748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424d780-32e6-4815-8192-a3ae92f76ff8 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.489012 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424d780-32e6-4815-8192-a3ae92f76ff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.490619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c424d780-32e6-4815-8192-a3ae92f76ff8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:36.497855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:36.586441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424d780-32e6-4815-8192-a3ae92f76ff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.588066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424d780-32e6-4815-8192-a3ae92f76ff8 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.606792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 728/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:37.692165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ad1f0-3678-4699-b3c7-ac341e3e1e02 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:37.693252 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ad1f0-3678-4699-b3c7-ac341e3e1e02 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:37.693252 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ad1f0-3678-4699-b3c7-ac341e3e1e02 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:37.695294 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:20:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:37.702909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9fdef-beb5-4d31-9e71-78155421755d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:37.703415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9fdef-beb5-4d31-9e71-78155421755d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:37.703519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9fdef-beb5-4d31-9e71-78155421755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:37.787657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0fb9fdef-beb5-4d31-9e71-78155421755d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:37.789489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0fb9fdef-beb5-4d31-9e71-78155421755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:37.864865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:38.018741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:38.175109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ad1f0-3678-4699-b3c7-ac341e3e1e02 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:38.177818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-540ad1f0-3678-4699-b3c7-ac341e3e1e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:38.197678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:38.331617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ad1f0-3678-4699-b3c7-ac341e3e1e02 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:38.424783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:38.452153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecc14a-c375-40c6-b0da-ff1f425be787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:38.452788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc14a-c375-40c6-b0da-ff1f425be787 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:38.453061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc14a-c375-40c6-b0da-ff1f425be787 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:38.453327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc14a-c375-40c6-b0da-ff1f425be787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:38.454910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-85ecc14a-c375-40c6-b0da-ff1f425be787 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:38.548666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecc14a-c375-40c6-b0da-ff1f425be787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:38.550275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecc14a-c375-40c6-b0da-ff1f425be787 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:38.568633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 705/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:39.620820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc3c0-8709-499f-b19b-9fc638f500d2 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:39.621692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc3c0-8709-499f-b19b-9fc638f500d2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:39.621692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc3c0-8709-499f-b19b-9fc638f500d2 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:39.623712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:20:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:39.634705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e620-b298-4e37-b837-6dcfed35abbf None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:39.635457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e620-b298-4e37-b837-6dcfed35abbf None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:39.635630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e620-b298-4e37-b837-6dcfed35abbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:39.719968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-5de9e620-b298-4e37-b837-6dcfed35abbf None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:39.721221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5de9e620-b298-4e37-b837-6dcfed35abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:39.763710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:39.822993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:39.974932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc3c0-8709-499f-b19b-9fc638f500d2 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:39.976349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a7acc3c0-8709-499f-b19b-9fc638f500d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:40.127912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc3c0-8709-499f-b19b-9fc638f500d2 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:40.185539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:40.248634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3ee49-8745-414c-9e9e-008a26c7ad10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:40.249158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3ee49-8745-414c-9e9e-008a26c7ad10 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:40.249433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3ee49-8745-414c-9e9e-008a26c7ad10 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:40.249702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3ee49-8745-414c-9e9e-008a26c7ad10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:40.251303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-77c3ee49-8745-414c-9e9e-008a26c7ad10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:40.360065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3ee49-8745-414c-9e9e-008a26c7ad10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:40.361717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3ee49-8745-414c-9e9e-008a26c7ad10 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:40.381705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 731/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:41.527407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cc39b-56a9-4e95-bfab-8bd92b4749be None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:41.528030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cc39b-56a9-4e95-bfab-8bd92b4749be None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:41.528030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cc39b-56a9-4e95-bfab-8bd92b4749be None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:41.530066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:20:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:20:41.540173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135622d8-ff93-4ecb-bd93-8c9dc173d84d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:41.540737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135622d8-ff93-4ecb-bd93-8c9dc173d84d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:41.540737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135622d8-ff93-4ecb-bd93-8c9dc173d84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:41.629104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-135622d8-ff93-4ecb-bd93-8c9dc173d84d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:41.630312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-135622d8-ff93-4ecb-bd93-8c9dc173d84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:41.632363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:41.739631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:41.894355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cc39b-56a9-4e95-bfab-8bd92b4749be None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:41.896685 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-158cc39b-56a9-4e95-bfab-8bd92b4749be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:42.074745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cc39b-56a9-4e95-bfab-8bd92b4749be None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:42.103145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:42.195031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a21d3-1c36-49d0-8e29-77e3a8298494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:42.195544 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a21d3-1c36-49d0-8e29-77e3a8298494 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:42.195824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a21d3-1c36-49d0-8e29-77e3a8298494 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:42.196101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a21d3-1c36-49d0-8e29-77e3a8298494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:42.197861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-1b0a21d3-1c36-49d0-8e29-77e3a8298494 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:42.296733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a21d3-1c36-49d0-8e29-77e3a8298494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:42.298338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a21d3-1c36-49d0-8e29-77e3a8298494 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:42.322576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 708/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:44.443281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b735b-5bb5-4e21-a559-fe2ddf512214 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:44.444180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b735b-5bb5-4e21-a559-fe2ddf512214 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:44.444180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b735b-5bb5-4e21-a559-fe2ddf512214 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:44.446507 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:20:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:44.452341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9fd8e-a391-4cab-a408-d30c2a087554 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:44.452814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9fd8e-a391-4cab-a408-d30c2a087554 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:44.452923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9fd8e-a391-4cab-a408-d30c2a087554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:44.499354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:44.526627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-86e9fd8e-a391-4cab-a408-d30c2a087554 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:44.527823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-86e9fd8e-a391-4cab-a408-d30c2a087554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:44.637405 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:44.940653 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b735b-5bb5-4e21-a559-fe2ddf512214 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:44.943247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-fc6b735b-5bb5-4e21-a559-fe2ddf512214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:45.058441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b735b-5bb5-4e21-a559-fe2ddf512214 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:45.091884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:45.137655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ff4e7-8f17-49f9-aee9-4a2cb50a0dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:45.138301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff4e7-8f17-49f9-aee9-4a2cb50a0dae service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:45.138577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff4e7-8f17-49f9-aee9-4a2cb50a0dae service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:45.138854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff4e7-8f17-49f9-aee9-4a2cb50a0dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:45.140524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c21ff4e7-8f17-49f9-aee9-4a2cb50a0dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:45.266374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ff4e7-8f17-49f9-aee9-4a2cb50a0dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:45.267806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ff4e7-8f17-49f9-aee9-4a2cb50a0dae service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:45.286642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 734/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:47.586459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a88297-2465-4fb5-919c-ebcc3d22187c None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:47.587290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a88297-2465-4fb5-919c-ebcc3d22187c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:47.587290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a88297-2465-4fb5-919c-ebcc3d22187c None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:47.588660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:47.595061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44557e5e-83a7-4d74-a257-5500138fde80 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:47.595537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44557e5e-83a7-4d74-a257-5500138fde80 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:47.595646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44557e5e-83a7-4d74-a257-5500138fde80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:47.681430 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-44557e5e-83a7-4d74-a257-5500138fde80 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:47.682668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-44557e5e-83a7-4d74-a257-5500138fde80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:47.697442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:47.790800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:48.081853 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a88297-2465-4fb5-919c-ebcc3d22187c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:48.084232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-27a88297-2465-4fb5-919c-ebcc3d22187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:48.214804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a88297-2465-4fb5-919c-ebcc3d22187c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:48.229277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:48.303042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da87ae-405a-47f9-85f5-d357cacf80bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:48.303708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da87ae-405a-47f9-85f5-d357cacf80bd service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:48.303982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da87ae-405a-47f9-85f5-d357cacf80bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:48.304254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da87ae-405a-47f9-85f5-d357cacf80bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:48.306048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-19da87ae-405a-47f9-85f5-d357cacf80bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:48.433989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da87ae-405a-47f9-85f5-d357cacf80bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:48.435343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da87ae-405a-47f9-85f5-d357cacf80bd service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:48.454773 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 711/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:50.911426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149cc8-c06e-4b44-8098-6fb5de5f1dcd None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.911987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149cc8-c06e-4b44-8098-6fb5de5f1dcd None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.911987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149cc8-c06e-4b44-8098-6fb5de5f1dcd None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.913354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:50.920908 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40836a-42a5-4b10-aa8a-d71454670559 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.921372 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40836a-42a5-4b10-aa8a-d71454670559 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.921481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40836a-42a5-4b10-aa8a-d71454670559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.983337 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:51.007521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4d40836a-42a5-4b10-aa8a-d71454670559 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:51.008894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4d40836a-42a5-4b10-aa8a-d71454670559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:51.113039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:51.404797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149cc8-c06e-4b44-8098-6fb5de5f1dcd None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:51.407369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cf149cc8-c06e-4b44-8098-6fb5de5f1dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:51.529873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149cc8-c06e-4b44-8098-6fb5de5f1dcd None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:51.573086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:51.607568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e68504-21eb-45ab-be4b-ffba4ac559bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:51.608167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e68504-21eb-45ab-be4b-ffba4ac559bd service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:51.608474 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e68504-21eb-45ab-be4b-ffba4ac559bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:51.608736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e68504-21eb-45ab-be4b-ffba4ac559bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:51.610318 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b9e68504-21eb-45ab-be4b-ffba4ac559bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:51.746661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e68504-21eb-45ab-be4b-ffba4ac559bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:51.748042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e68504-21eb-45ab-be4b-ffba4ac559bd service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:51.767493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 737/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:54.028877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72274268-693e-468c-ae53-753548d01e0c None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:54.029432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72274268-693e-468c-ae53-753548d01e0c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:54.029432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72274268-693e-468c-ae53-753548d01e0c None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:54.031298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:20:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:54.040557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc0855-2b5a-46ab-9420-33a40d9767a0 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:54.041035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc0855-2b5a-46ab-9420-33a40d9767a0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:54.041176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc0855-2b5a-46ab-9420-33a40d9767a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:54.112171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-a9fc0855-2b5a-46ab-9420-33a40d9767a0 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:54.113419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a9fc0855-2b5a-46ab-9420-33a40d9767a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:54.135975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:54.227931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:54.519085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72274268-693e-468c-ae53-753548d01e0c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:54.520656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-72274268-693e-468c-ae53-753548d01e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:54.626668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72274268-693e-468c-ae53-753548d01e0c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:54.650053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:54.715713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957676e-4354-40f1-8aa0-39b5451489ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:54.716320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957676e-4354-40f1-8aa0-39b5451489ce service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:54.716626 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957676e-4354-40f1-8aa0-39b5451489ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:54.716898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957676e-4354-40f1-8aa0-39b5451489ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:54.718525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0957676e-4354-40f1-8aa0-39b5451489ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:54.843500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957676e-4354-40f1-8aa0-39b5451489ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:54.844977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957676e-4354-40f1-8aa0-39b5451489ce service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:54.864087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 714/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:57.066286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5be0f4-bcd5-431f-b144-1b247b88468d None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:57.067205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5be0f4-bcd5-431f-b144-1b247b88468d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:57.067205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5be0f4-bcd5-431f-b144-1b247b88468d None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:57.069297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:20:57.075091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd1056-56d0-4aa8-8f72-a4f00fae2ed9 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:57.075520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd1056-56d0-4aa8-8f72-a4f00fae2ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:57.075636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd1056-56d0-4aa8-8f72-a4f00fae2ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:57.147614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:57.150512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-efcd1056-56d0-4aa8-8f72-a4f00fae2ed9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:57.152188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-efcd1056-56d0-4aa8-8f72-a4f00fae2ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:57.255627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:57.541219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5be0f4-bcd5-431f-b144-1b247b88468d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:57.544143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ac5be0f4-bcd5-431f-b144-1b247b88468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:57.668222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5be0f4-bcd5-431f-b144-1b247b88468d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:57.723828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:57.752503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fb8cf-c182-4413-8ee1-5d970922a2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:57.753112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fb8cf-c182-4413-8ee1-5d970922a2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:57.753383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fb8cf-c182-4413-8ee1-5d970922a2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:57.753646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fb8cf-c182-4413-8ee1-5d970922a2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:57.755237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b84fb8cf-c182-4413-8ee1-5d970922a2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:57.891101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fb8cf-c182-4413-8ee1-5d970922a2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:57.892489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fb8cf-c182-4413-8ee1-5d970922a2b5 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:57.910788 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 740/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:00.181172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95169b-2e82-4aea-9440-2d3edadff345 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:00.181772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95169b-2e82-4aea-9440-2d3edadff345 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:00.181772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95169b-2e82-4aea-9440-2d3edadff345 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:00.183517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:21:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:00.190180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e41939-b4cb-4bdc-adc7-2c1a06986c4c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:00.190624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e41939-b4cb-4bdc-adc7-2c1a06986c4c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:00.190745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e41939-b4cb-4bdc-adc7-2c1a06986c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:00.263457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-76e41939-b4cb-4bdc-adc7-2c1a06986c4c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:00.264980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-76e41939-b4cb-4bdc-adc7-2c1a06986c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:00.296312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:00.368931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:00.662543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95169b-2e82-4aea-9440-2d3edadff345 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:00.664348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6c95169b-2e82-4aea-9440-2d3edadff345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:00.785093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95169b-2e82-4aea-9440-2d3edadff345 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:00.815996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:00.863361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac572fba-8efb-4be4-b278-3cf1b6e23937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:00.863978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572fba-8efb-4be4-b278-3cf1b6e23937 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:00.864258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572fba-8efb-4be4-b278-3cf1b6e23937 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:00.864787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572fba-8efb-4be4-b278-3cf1b6e23937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:00.866398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ac572fba-8efb-4be4-b278-3cf1b6e23937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:00.984332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac572fba-8efb-4be4-b278-3cf1b6e23937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:00.985698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac572fba-8efb-4be4-b278-3cf1b6e23937 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:01.004991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 717/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:21:03.248940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581393-acdb-4871-99fe-e00161bf8c36 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:03.249765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581393-acdb-4871-99fe-e00161bf8c36 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:03.249765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581393-acdb-4871-99fe-e00161bf8c36 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:03.251979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:21:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:03.261331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1c4c5-6cda-4b49-8a5e-410e7a1b7f8d None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:03.262132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1c4c5-6cda-4b49-8a5e-410e7a1b7f8d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:03.262294 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1c4c5-6cda-4b49-8a5e-410e7a1b7f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:03.345108 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-bbb1c4c5-6cda-4b49-8a5e-410e7a1b7f8d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:03.346618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-bbb1c4c5-6cda-4b49-8a5e-410e7a1b7f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:03.360283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:03.463843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:03.761015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c581393-acdb-4871-99fe-e00161bf8c36 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:03.762947 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4c581393-acdb-4871-99fe-e00161bf8c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:03.880015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c581393-acdb-4871-99fe-e00161bf8c36 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:03.945911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:03.965581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ab81b-7933-44c8-832f-95b250977e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:03.966198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ab81b-7933-44c8-832f-95b250977e4c service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:03.966596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ab81b-7933-44c8-832f-95b250977e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:03.966860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ab81b-7933-44c8-832f-95b250977e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:03.968509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a68ab81b-7933-44c8-832f-95b250977e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:04.082623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ab81b-7933-44c8-832f-95b250977e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:04.084107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ab81b-7933-44c8-832f-95b250977e4c service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:04.102925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 743/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:06.352680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84b77-e891-4e6d-814c-b10dd10fa84e None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:06.353603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84b77-e891-4e6d-814c-b10dd10fa84e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:06.353603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84b77-e891-4e6d-814c-b10dd10fa84e None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:06.355743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:21:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:06.362253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2a66f-23a5-4c03-afe0-83369640d3e4 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:06.362957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2a66f-23a5-4c03-afe0-83369640d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:06.363155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2a66f-23a5-4c03-afe0-83369640d3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:06.439907 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f2d2a66f-23a5-4c03-afe0-83369640d3e4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:06.441181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f2d2a66f-23a5-4c03-afe0-83369640d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:06.481717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:06.543416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:06.832100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d84b77-e891-4e6d-814c-b10dd10fa84e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:06.834484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e5d84b77-e891-4e6d-814c-b10dd10fa84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:06.974588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d84b77-e891-4e6d-814c-b10dd10fa84e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:07.024238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:07.062215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d1136-2f8c-4862-b2e7-04c712f75507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:07.062812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d1136-2f8c-4862-b2e7-04c712f75507 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.063083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d1136-2f8c-4862-b2e7-04c712f75507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.063294 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d1136-2f8c-4862-b2e7-04c712f75507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.064942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c19d1136-2f8c-4862-b2e7-04c712f75507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:07.182408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d1136-2f8c-4862-b2e7-04c712f75507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:07.183854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d1136-2f8c-4862-b2e7-04c712f75507 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:07.202853 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 720/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:09.391884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7795c5-b9ac-49ed-b491-d9fcdf26ffaa None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:09.392525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7795c5-b9ac-49ed-b491-d9fcdf26ffaa None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:09.392525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7795c5-b9ac-49ed-b491-d9fcdf26ffaa None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:09.393849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:09.400406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e1e64-e450-44b4-b281-dd31d85bff89 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:09.400923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e1e64-e450-44b4-b281-dd31d85bff89 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:09.401036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e1e64-e450-44b4-b281-dd31d85bff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:09.491149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-8a7e1e64-e450-44b4-b281-dd31d85bff89 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:09.492609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8a7e1e64-e450-44b4-b281-dd31d85bff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:09.513858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:09.604128 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:09.896247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7795c5-b9ac-49ed-b491-d9fcdf26ffaa None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:09.899047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-fd7795c5-b9ac-49ed-b491-d9fcdf26ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:10.019018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7795c5-b9ac-49ed-b491-d9fcdf26ffaa None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:10.092983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:10.101530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90187755-6913-4a52-a0d4-2cd5cef1de76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:10.102152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90187755-6913-4a52-a0d4-2cd5cef1de76 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:10.102423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90187755-6913-4a52-a0d4-2cd5cef1de76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:10.102701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90187755-6913-4a52-a0d4-2cd5cef1de76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:10.104503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-90187755-6913-4a52-a0d4-2cd5cef1de76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:10.245796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90187755-6913-4a52-a0d4-2cd5cef1de76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:10.247938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90187755-6913-4a52-a0d4-2cd5cef1de76 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:10.276511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 746/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:12.422103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced0dc0-5099-4ba6-ad32-42662c963c61 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:12.422723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced0dc0-5099-4ba6-ad32-42662c963c61 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:12.422723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced0dc0-5099-4ba6-ad32-42662c963c61 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:12.424004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:12.429791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a49d5c-5919-4492-ab4c-05cbdae31b19 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:12.430236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a49d5c-5919-4492-ab4c-05cbdae31b19 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:12.430347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a49d5c-5919-4492-ab4c-05cbdae31b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:12.506597 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-68a49d5c-5919-4492-ab4c-05cbdae31b19 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:12.508039 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-68a49d5c-5919-4492-ab4c-05cbdae31b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:12.565734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:12.618436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:12.895549 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced0dc0-5099-4ba6-ad32-42662c963c61 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:12.897150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3ced0dc0-5099-4ba6-ad32-42662c963c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:13.008311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced0dc0-5099-4ba6-ad32-42662c963c61 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:13.063404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:13.090622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930b6f1-737d-4daf-ac92-40980e9f1161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:13.091213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930b6f1-737d-4daf-ac92-40980e9f1161 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:13.091490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930b6f1-737d-4daf-ac92-40980e9f1161 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:13.091762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930b6f1-737d-4daf-ac92-40980e9f1161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:13.093423 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e930b6f1-737d-4daf-ac92-40980e9f1161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:13.237550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930b6f1-737d-4daf-ac92-40980e9f1161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:13.239025 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930b6f1-737d-4daf-ac92-40980e9f1161 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:13.259933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 723/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:22.616757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=22 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:23.256805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=66 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:33.278063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4981-72db-44a7-8758-536f03c29058 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:33.278795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4981-72db-44a7-8758-536f03c29058 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:33.278795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4981-72db-44a7-8758-536f03c29058 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:33.281053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 748/1471] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:21:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:33.286754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e14d3a-1661-460c-9221-929a218d0aff None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:33.287218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e14d3a-1661-460c-9221-929a218d0aff None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:33.287315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e14d3a-1661-460c-9221-929a218d0aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:33.355883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-c7e14d3a-1661-460c-9221-929a218d0aff None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:33.357633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c7e14d3a-1661-460c-9221-929a218d0aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:33.468726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 724/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:33.772372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc448ae-0b91-4de2-9911-064ca96804ca None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:33.772752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc448ae-0b91-4de2-9911-064ca96804ca None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:33.773029 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc448ae-0b91-4de2-9911-064ca96804ca None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:33.774421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 749/1473] 10.222.0.49 () {54 vars in 962 bytes} [Fri Sep 16 19:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:33.781562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e786748-69ea-4f1f-bc1c-a33f6c2e2159 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:33.781822 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e786748-69ea-4f1f-bc1c-a33f6c2e2159 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:33.782282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e786748-69ea-4f1f-bc1c-a33f6c2e2159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:33.859070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4e786748-69ea-4f1f-bc1c-a33f6c2e2159 None None] MFA Rules not processed for user `7f83a7e0c14541788c92e3d96b839077`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:33.860188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4e786748-69ea-4f1f-bc1c-a33f6c2e2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:33.880656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:33.942453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 725/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Fri Sep 16 19:21:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:33.954058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc448ae-0b91-4de2-9911-064ca96804ca None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:33.955575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5bc448ae-0b91-4de2-9911-064ca96804ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:34.074296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc448ae-0b91-4de2-9911-064ca96804ca None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:34.149294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc03ba9-0ff2-418a-8089-8cee9276d92d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f83a7e0c14541788c92e3d96b839077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:34.149811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03ba9-0ff2-418a-8089-8cee9276d92d service glance] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:34.150080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03ba9-0ff2-418a-8089-8cee9276d92d service glance] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:34.150354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03ba9-0ff2-418a-8089-8cee9276d92d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:34.151925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-edc03ba9-0ff2-418a-8089-8cee9276d92d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:34.207814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:34.265762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc03ba9-0ff2-418a-8089-8cee9276d92d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:34.267205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc03ba9-0ff2-418a-8089-8cee9276d92d service glance] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:34.285805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 750/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:36.544571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd9f4-2bbd-4765-b531-4fc07394558e None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:36.545505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd9f4-2bbd-4765-b531-4fc07394558e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:36.545505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd9f4-2bbd-4765-b531-4fc07394558e None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:36.547614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 726/1476] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:21:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:36.553670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8306f6-4f43-4194-84e0-ae6d261b93b5 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:36.554125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8306f6-4f43-4194-84e0-ae6d261b93b5 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:36.554222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8306f6-4f43-4194-84e0-ae6d261b93b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:36.623017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1f8306f6-4f43-4194-84e0-ae6d261b93b5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:36.624249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1f8306f6-4f43-4194-84e0-ae6d261b93b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:36.729201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 751/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:21:37.012577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd9f4-2bbd-4765-b531-4fc07394558e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:37.014142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-254dd9f4-2bbd-4765-b531-4fc07394558e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:37.273115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd9f4-2bbd-4765-b531-4fc07394558e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:37.327123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:37.375935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75acd5-fae6-4f30-b0d8-b8df9b29a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:37.376581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75acd5-fae6-4f30-b0d8-b8df9b29a989 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:37.376858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75acd5-fae6-4f30-b0d8-b8df9b29a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:37.377124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75acd5-fae6-4f30-b0d8-b8df9b29a989 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:37.377760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75acd5-fae6-4f30-b0d8-b8df9b29a989 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:37.379622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: WARNING py.warnings [None req-2a75acd5-fae6-4f30-b0d8-b8df9b29a989 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:21:37.379622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: warnings.warn(msg) Sep 16 19:21:37.379622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: Sep 16 19:21:37.380813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75acd5-fae6-4f30-b0d8-b8df9b29a989 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:37.400979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 727/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Sep 16 19:21:37 2022] GET /identity/v3/projects => generated 2553 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:21:39.588284 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428329f-a9ae-42ff-8591-48740aeb375b None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:39.588966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428329f-a9ae-42ff-8591-48740aeb375b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:39.588966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428329f-a9ae-42ff-8591-48740aeb375b None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:39.590220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 752/1479] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:39.596653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f22a9-6fbf-4632-9422-5423837eda06 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:39.597400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f22a9-6fbf-4632-9422-5423837eda06 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:39.597573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f22a9-6fbf-4632-9422-5423837eda06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:39.669616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-993f22a9-6fbf-4632-9422-5423837eda06 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:39.670749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-993f22a9-6fbf-4632-9422-5423837eda06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:39.772908 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 728/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:40.066148 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428329f-a9ae-42ff-8591-48740aeb375b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:40.068255 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4428329f-a9ae-42ff-8591-48740aeb375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:40.078344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:40.220598 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428329f-a9ae-42ff-8591-48740aeb375b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:40.314833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:40.350490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dd0fc-3fda-42be-a7fc-c64aec188d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:40.351073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dd0fc-3fda-42be-a7fc-c64aec188d56 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:40.351372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dd0fc-3fda-42be-a7fc-c64aec188d56 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:40.351627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dd0fc-3fda-42be-a7fc-c64aec188d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:40.353250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-835dd0fc-3fda-42be-a7fc-c64aec188d56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:40.445097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835dd0fc-3fda-42be-a7fc-c64aec188d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:40.446730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835dd0fc-3fda-42be-a7fc-c64aec188d56 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:40.466124 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 753/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:42.874265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a577f5-b06a-4447-a3e2-1f8ffcf9a3c5 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:42.874907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a577f5-b06a-4447-a3e2-1f8ffcf9a3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:42.874907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a577f5-b06a-4447-a3e2-1f8ffcf9a3c5 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:42.876842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 729/1482] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:21:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:42.882512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f762ad-9afb-4118-b6f0-a84e1008e06e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:42.882966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f762ad-9afb-4118-b6f0-a84e1008e06e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:42.883085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f762ad-9afb-4118-b6f0-a84e1008e06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:42.958007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-60f762ad-9afb-4118-b6f0-a84e1008e06e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:42.959227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-60f762ad-9afb-4118-b6f0-a84e1008e06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:43.016709 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:43.074439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 754/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:43.360257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a577f5-b06a-4447-a3e2-1f8ffcf9a3c5 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:43.361858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-87a577f5-b06a-4447-a3e2-1f8ffcf9a3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:43.389102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:43.478826 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a577f5-b06a-4447-a3e2-1f8ffcf9a3c5 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:43.560014 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85f3f1-5f10-4c32-be47-77514d858017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:43.560656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f3f1-5f10-4c32-be47-77514d858017 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:43.560935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f3f1-5f10-4c32-be47-77514d858017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:43.561206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f3f1-5f10-4c32-be47-77514d858017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:43.562838 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3c85f3f1-5f10-4c32-be47-77514d858017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:43.639881 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:43.684800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85f3f1-5f10-4c32-be47-77514d858017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:43.686227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85f3f1-5f10-4c32-be47-77514d858017 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:43.704772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 730/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:21:45.897534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9e12-6884-49ad-9d53-5b9b8d9fd39c None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:45.898101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9e12-6884-49ad-9d53-5b9b8d9fd39c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:45.898101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9e12-6884-49ad-9d53-5b9b8d9fd39c None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:45.899448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 755/1485] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:45.905940 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6ea0d-4320-4595-92c4-6989d52143fa None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:45.906394 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6ea0d-4320-4595-92c4-6989d52143fa None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:45.906542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6ea0d-4320-4595-92c4-6989d52143fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:45.976675 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-86d6ea0d-4320-4595-92c4-6989d52143fa None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:45.977964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-86d6ea0d-4320-4595-92c4-6989d52143fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:46.080270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 731/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:46.381561 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a9e12-6884-49ad-9d53-5b9b8d9fd39c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:46.383125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1a5a9e12-6884-49ad-9d53-5b9b8d9fd39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:46.495391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a9e12-6884-49ad-9d53-5b9b8d9fd39c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:46.573236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:46.575140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329ea9f-6cf4-4bf7-83b8-5c0232cfc49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:46.576133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ea9f-6cf4-4bf7-83b8-5c0232cfc49d service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:46.576489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ea9f-6cf4-4bf7-83b8-5c0232cfc49d service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:46.576760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ea9f-6cf4-4bf7-83b8-5c0232cfc49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:46.579816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a329ea9f-6cf4-4bf7-83b8-5c0232cfc49d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:46.710573 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329ea9f-6cf4-4bf7-83b8-5c0232cfc49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:46.711944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329ea9f-6cf4-4bf7-83b8-5c0232cfc49d service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:46.736047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 756/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:48.987687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08618d57-99f7-42fd-9845-361d3de9d8df None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:48.988774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08618d57-99f7-42fd-9845-361d3de9d8df None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:48.988774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08618d57-99f7-42fd-9845-361d3de9d8df None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:48.990996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 732/1488] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:21:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:48.997524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6c5de-9110-4a1d-b593-9ba0872c9820 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:48.997992 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6c5de-9110-4a1d-b593-9ba0872c9820 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:48.998098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6c5de-9110-4a1d-b593-9ba0872c9820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:49.075154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-98d6c5de-9110-4a1d-b593-9ba0872c9820 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:49.076277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-98d6c5de-9110-4a1d-b593-9ba0872c9820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:49.142266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:49.193253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 757/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:49.492887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08618d57-99f7-42fd-9845-361d3de9d8df None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:49.495370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-08618d57-99f7-42fd-9845-361d3de9d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:49.537292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:49.609902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08618d57-99f7-42fd-9845-361d3de9d8df None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:49.696281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58edab-bb9d-4e79-8530-b9a74263a91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:49.696913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58edab-bb9d-4e79-8530-b9a74263a91b service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:49.697179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58edab-bb9d-4e79-8530-b9a74263a91b service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:49.697442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58edab-bb9d-4e79-8530-b9a74263a91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:49.699016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-bf58edab-bb9d-4e79-8530-b9a74263a91b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:49.794026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:49.825249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58edab-bb9d-4e79-8530-b9a74263a91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:49.826741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58edab-bb9d-4e79-8530-b9a74263a91b service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:49.845258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 733/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:52.299745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baddf04-35e3-4a18-9730-1a106b3e32a7 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:52.300355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baddf04-35e3-4a18-9730-1a106b3e32a7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:52.300355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baddf04-35e3-4a18-9730-1a106b3e32a7 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:52.301804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 758/1491] 10.222.0.49 () {54 vars in 927 bytes} [Fri Sep 16 19:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:52.308289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a394-c8c7-4659-ad91-a49ca4dc495e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:52.309086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a394-c8c7-4659-ad91-a49ca4dc495e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:52.309220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a394-c8c7-4659-ad91-a49ca4dc495e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:52.393568 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-a266a394-c8c7-4659-ad91-a49ca4dc495e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:52.395316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a266a394-c8c7-4659-ad91-a49ca4dc495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:52.521603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 734/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Sep 16 19:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:52.823031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baddf04-35e3-4a18-9730-1a106b3e32a7 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:52.825492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0baddf04-35e3-4a18-9730-1a106b3e32a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:52.940074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baddf04-35e3-4a18-9730-1a106b3e32a7 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:53.015311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b18ef3-a9e8-473a-8057-49a7930aa693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:53.015905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b18ef3-a9e8-473a-8057-49a7930aa693 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:53.016177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b18ef3-a9e8-473a-8057-49a7930aa693 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:53.016453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b18ef3-a9e8-473a-8057-49a7930aa693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:53.018146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e0b18ef3-a9e8-473a-8057-49a7930aa693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:53.027077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:53.142424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b18ef3-a9e8-473a-8057-49a7930aa693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:53.143893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b18ef3-a9e8-473a-8057-49a7930aa693 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:53.163433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 759/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:22:02.518859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=82 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:22:03.160677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=50 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:20.998134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169a535-d491-44ef-a24a-7c48e67d6fb2 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:20.999015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169a535-d491-44ef-a24a-7c48e67d6fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:20.999015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169a535-d491-44ef-a24a-7c48e67d6fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:21.085719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4169a535-d491-44ef-a24a-7c48e67d6fb2 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:23:21.086857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4169a535-d491-44ef-a24a-7c48e67d6fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:21.202902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 735/1494] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:23:21.211446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a339-a63b-408e-a972-e7f7944a8c3a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:21.212003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a339-a63b-408e-a972-e7f7944a8c3a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:21.212003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a339-a63b-408e-a972-e7f7944a8c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:21.304447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5cc6a339-a63b-408e-a972-e7f7944a8c3a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:23:21.305950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5cc6a339-a63b-408e-a972-e7f7944a8c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:21.412065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 760/1495] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:23:21.417564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169a535-d491-44ef-a24a-7c48e67d6fb2 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:21.419417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4169a535-d491-44ef-a24a-7c48e67d6fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:21.433776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169a535-d491-44ef-a24a-7c48e67d6fb2 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:21.498869 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:21.535007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:21.535606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:21.535875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:21.536193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:21.537143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:23:21.537442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:21.538446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: WARNING py.warnings [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:23:21.538446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: warnings.warn(msg) Sep 16 19:23:21.538446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: Sep 16 19:23:21.539335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:21.550772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 736/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:23:21.559897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a339-a63b-408e-a972-e7f7944a8c3a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:21.570095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a339-a63b-408e-a972-e7f7944a8c3a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:21.639602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:21.676941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e82030-509c-4f98-ae5d-fd4f43b04b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:21.677488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e82030-509c-4f98-ae5d-fd4f43b04b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:21.677761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e82030-509c-4f98-ae5d-fd4f43b04b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:21.678028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e82030-509c-4f98-ae5d-fd4f43b04b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:21.678661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e82030-509c-4f98-ae5d-fd4f43b04b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:21.680437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: WARNING py.warnings [None req-e2e82030-509c-4f98-ae5d-fd4f43b04b2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:23:21.680437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: warnings.warn(msg) Sep 16 19:23:21.680437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: Sep 16 19:23:21.681650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e82030-509c-4f98-ae5d-fd4f43b04b2b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:21.744995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 761/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:23:21 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:23:21.749373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:21.750908 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:21.785825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49e00d-75f0-47c3-ac09-4e7d2cecca53 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:21.898038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d71d-a770-4ab0-a0f6-eaf6d8bc3034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:21.898645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d71d-a770-4ab0-a0f6-eaf6d8bc3034 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:21.898921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d71d-a770-4ab0-a0f6-eaf6d8bc3034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:21.899191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d71d-a770-4ab0-a0f6-eaf6d8bc3034 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:21.899827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867d71d-a770-4ab0-a0f6-eaf6d8bc3034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:21.900877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: WARNING py.warnings [None req-c867d71d-a770-4ab0-a0f6-eaf6d8bc3034 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:23:21.900877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: warnings.warn(msg) Sep 16 19:23:21.900877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: Sep 16 19:23:21.902106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867d71d-a770-4ab0-a0f6-eaf6d8bc3034 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:21.950553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 737/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:23:21 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:23:21.954805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e82030-509c-4f98-ae5d-fd4f43b04b2b admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:21.956410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e2e82030-509c-4f98-ae5d-fd4f43b04b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:22.021844 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e82030-509c-4f98-ae5d-fd4f43b04b2b admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:22.109550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:22.122166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c63459-32d1-42f3-b12c-057c40fde03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:22.122783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c63459-32d1-42f3-b12c-057c40fde03e admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:22.123061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c63459-32d1-42f3-b12c-057c40fde03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:22.123331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c63459-32d1-42f3-b12c-057c40fde03e admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:22.123976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c63459-32d1-42f3-b12c-057c40fde03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:22.125104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: WARNING py.warnings [None req-c6c63459-32d1-42f3-b12c-057c40fde03e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:23:22.125104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: warnings.warn(msg) Sep 16 19:23:22.125104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: Sep 16 19:23:22.126013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c63459-32d1-42f3-b12c-057c40fde03e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:22.138466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 762/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:23:22.145159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d71d-a770-4ab0-a0f6-eaf6d8bc3034 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:22.146870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c867d71d-a770-4ab0-a0f6-eaf6d8bc3034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:22.158842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d71d-a770-4ab0-a0f6-eaf6d8bc3034 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:22.184643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:22.255572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e954a-ef68-47e6-b9cc-efac7622a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:22.256089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e954a-ef68-47e6-b9cc-efac7622a383 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:22.256358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e954a-ef68-47e6-b9cc-efac7622a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:22.256650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e954a-ef68-47e6-b9cc-efac7622a383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:22.257289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e954a-ef68-47e6-b9cc-efac7622a383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:22.258299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: WARNING py.warnings [None req-7a3e954a-ef68-47e6-b9cc-efac7622a383 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:23:22.258299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: warnings.warn(msg) Sep 16 19:23:22.258299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: Sep 16 19:23:22.259191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e954a-ef68-47e6-b9cc-efac7622a383 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:22.272981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 738/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:23:22.277663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c63459-32d1-42f3-b12c-057c40fde03e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:22.279215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c6c63459-32d1-42f3-b12c-057c40fde03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:22.322908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c63459-32d1-42f3-b12c-057c40fde03e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:22.423707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63b1d2-6911-4d3a-9ce0-3bbad57a266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:22.424393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b1d2-6911-4d3a-9ce0-3bbad57a266b admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:22.424682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b1d2-6911-4d3a-9ce0-3bbad57a266b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:22.424955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b1d2-6911-4d3a-9ce0-3bbad57a266b admin admin] PATH_INFO: `/v3/projects/48fae6ed1a994f98bff5c3f92fa8bfb8/users/5568d3a283ed45c4bc8b98a985899936/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:22.454793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63b1d2-6911-4d3a-9ce0-3bbad57a266b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48fae6ed1a994f98bff5c3f92fa8bfb8, user_id=5568d3a283ed45c4bc8b98a985899936, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:22.455216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: WARNING py.warnings [None req-7b63b1d2-6911-4d3a-9ce0-3bbad57a266b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:23:22.455216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: warnings.warn(msg) Sep 16 19:23:22.455216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: Sep 16 19:23:22.457226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63b1d2-6911-4d3a-9ce0-3bbad57a266b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:22.487711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 763/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:23:22 2022] PUT /identity/v3/projects/48fae6ed1a994f98bff5c3f92fa8bfb8/users/5568d3a283ed45c4bc8b98a985899936/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:23:22.506117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ab2cf-7161-4ae4-bed6-f4ef5c982f8f None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:22.506320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ab2cf-7161-4ae4-bed6-f4ef5c982f8f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:22.506594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ab2cf-7161-4ae4-bed6-f4ef5c982f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:22.585313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-b93ab2cf-7161-4ae4-bed6-f4ef5c982f8f None None] MFA Rules not processed for user `5568d3a283ed45c4bc8b98a985899936`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:23:22.586553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b93ab2cf-7161-4ae4-bed6-f4ef5c982f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:22.668048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 739/1502] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:23:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:23:22.687580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696797f-890b-4744-ad2c-329c6efca11d None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:22.687858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696797f-890b-4744-ad2c-329c6efca11d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:22.688127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696797f-890b-4744-ad2c-329c6efca11d None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:22.689510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 764/1503] 10.222.0.49 () {54 vars in 964 bytes} [Fri Sep 16 19:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:23:22.694731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2da3-cb06-4b8e-bce8-21b41584d1cc None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:22.695011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2da3-cb06-4b8e-bce8-21b41584d1cc None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:22.695280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2da3-cb06-4b8e-bce8-21b41584d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:22.728462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:22.775320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ebeb2da3-cb06-4b8e-bce8-21b41584d1cc None None] MFA Rules not processed for user `f932b95e90774030b003f554d9f90481`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:23:22.776592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ebeb2da3-cb06-4b8e-bce8-21b41584d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:22.854491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 740/1504] 10.222.0.49 () {58 vars in 1061 bytes} [Fri Sep 16 19:23:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:23:22.862469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696797f-890b-4744-ad2c-329c6efca11d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:22.864107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1696797f-890b-4744-ad2c-329c6efca11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:22.921156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:22.978257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696797f-890b-4744-ad2c-329c6efca11d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:23.058586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e95d25-43b8-4258-86b4-82729241ea45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:23.059205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e95d25-43b8-4258-86b4-82729241ea45 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:23.059482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e95d25-43b8-4258-86b4-82729241ea45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:23.059751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e95d25-43b8-4258-86b4-82729241ea45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:23.061415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-83e95d25-43b8-4258-86b4-82729241ea45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:23.176184 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e95d25-43b8-4258-86b4-82729241ea45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:23.178033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e95d25-43b8-4258-86b4-82729241ea45 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:23.181609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:23.204012 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 765/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:23:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:23:23.252328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d5688-3fbe-4f2a-ada7-52aa58e43b36 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:23.252779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d5688-3fbe-4f2a-ada7-52aa58e43b36 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:23.252916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d5688-3fbe-4f2a-ada7-52aa58e43b36 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:23.254981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 741/1506] 10.222.0.49 () {52 vars in 830 bytes} [Fri Sep 16 19:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:23:23.258958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e95d25-43b8-4258-86b4-82729241ea45 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:23.260200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-83e95d25-43b8-4258-86b4-82729241ea45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:23.380113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e95d25-43b8-4258-86b4-82729241ea45 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:23.488697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:23.489638 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:23.489979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:23.490250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] PATH_INFO: `/v3/users/5568d3a283ed45c4bc8b98a985899936` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:23.506826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5568d3a283ed45c4bc8b98a985899936)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:23.507865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: WARNING py.warnings [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:23:23.507865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: warnings.warn(msg) Sep 16 19:23:23.507865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: Sep 16 19:23:23.509134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:23.519175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:23.582032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5568d3a283ed45c4bc8b98a985899936'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:23:23.582466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5568d3a283ed45c4bc8b98a985899936'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:23:23.583621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5568d3a283ed45c4bc8b98a985899936'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:23:23.597290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5568d3a283ed45c4bc8b98a985899936'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:23:23.623381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5568d3a283ed45c4bc8b98a985899936'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:23:23.646770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 766/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:23:23 2022] DELETE /identity/v3/users/5568d3a283ed45c4bc8b98a985899936 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:23:23.651340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cce78-38d7-4c2c-9827-23b6f1c9cba5 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:23.651627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cce78-38d7-4c2c-9827-23b6f1c9cba5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:23.651937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cce78-38d7-4c2c-9827-23b6f1c9cba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:23.709623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f46cce78-38d7-4c2c-9827-23b6f1c9cba5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:23:23.710825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f46cce78-38d7-4c2c-9827-23b6f1c9cba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:23.790044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:23.804073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 742/1508] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:23:23.816065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:23.817419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:23.932656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186afa6-5afd-4b0a-bbc8-540fbd703f48 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:23.995334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:24.017976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853effc-43c7-415a-9db8-cf28ef95fbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:24.018699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853effc-43c7-415a-9db8-cf28ef95fbaa service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:24.018976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853effc-43c7-415a-9db8-cf28ef95fbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:24.019247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853effc-43c7-415a-9db8-cf28ef95fbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:24.021483 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d853effc-43c7-415a-9db8-cf28ef95fbaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:24.150724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853effc-43c7-415a-9db8-cf28ef95fbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:24.152201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853effc-43c7-415a-9db8-cf28ef95fbaa service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:24.172000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 767/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:23:24.546599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cce78-38d7-4c2c-9827-23b6f1c9cba5 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:24.547881 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f46cce78-38d7-4c2c-9827-23b6f1c9cba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:24.561492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cce78-38d7-4c2c-9827-23b6f1c9cba5 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:24.659733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:24.660365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:24.660673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:24.661011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] PATH_INFO: `/v3/projects/48fae6ed1a994f98bff5c3f92fa8bfb8` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:24.671247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=48fae6ed1a994f98bff5c3f92fa8bfb8)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:24.672265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: WARNING py.warnings [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:23:24.672265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: warnings.warn(msg) Sep 16 19:23:24.672265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: Sep 16 19:23:24.673512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:24.736500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48fae6ed1a994f98bff5c3f92fa8bfb8', 'request_id': 'req-ada2c5dd-9c47-46db-875f-f20435c19dbe'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:23:24.750278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48fae6ed1a994f98bff5c3f92fa8bfb8', 'request_id': 'req-ada2c5dd-9c47-46db-875f-f20435c19dbe'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:23:24.763839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48fae6ed1a994f98bff5c3f92fa8bfb8', 'request_id': 'req-ada2c5dd-9c47-46db-875f-f20435c19dbe'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:23:24.790570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] The token cache is being invalidate because project 48fae6ed1a994f98bff5c3f92fa8bfb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:23:24.790748 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:23:24.791291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ada2c5dd-9c47-46db-875f-f20435c19dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:23:24.792662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 743/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:23:24 2022] DELETE /identity/v3/projects/48fae6ed1a994f98bff5c3f92fa8bfb8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:23:34.169355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=62 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:34.788188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:24:52.875110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb112f-b9af-4b66-ba13-381f9171ba88 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:52.875736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb112f-b9af-4b66-ba13-381f9171ba88 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:52.875736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb112f-b9af-4b66-ba13-381f9171ba88 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:52.877781 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:24:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:24:52.886521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188c35-564f-4222-bad2-b397be9293aa None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:52.887311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188c35-564f-4222-bad2-b397be9293aa None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:52.887491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188c35-564f-4222-bad2-b397be9293aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:52.979490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-0d188c35-564f-4222-bad2-b397be9293aa None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:24:52.980747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0d188c35-564f-4222-bad2-b397be9293aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:53.087927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:24:53.246207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb112f-b9af-4b66-ba13-381f9171ba88 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:53.250116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-29bb112f-b9af-4b66-ba13-381f9171ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:53.381295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb112f-b9af-4b66-ba13-381f9171ba88 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:53.387456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b2f83-8dee-4f3b-b7db-afe2dbf20e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:53.388064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b2f83-8dee-4f3b-b7db-afe2dbf20e54 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:53.388345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b2f83-8dee-4f3b-b7db-afe2dbf20e54 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:53.388646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b2f83-8dee-4f3b-b7db-afe2dbf20e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:53.397071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b2f83-8dee-4f3b-b7db-afe2dbf20e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:53.398726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b2f83-8dee-4f3b-b7db-afe2dbf20e54 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:53.408843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 769/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:24:54.509002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a226-a531-4e8a-a2d1-10cef4616c26 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:54.509610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a226-a531-4e8a-a2d1-10cef4616c26 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:54.509610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a226-a531-4e8a-a2d1-10cef4616c26 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:54.510917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 745/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:24:54.518522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905e6d-bfd0-468c-8ac0-a6b35dc520ae None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:54.518999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905e6d-bfd0-468c-8ac0-a6b35dc520ae None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:54.519103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905e6d-bfd0-468c-8ac0-a6b35dc520ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:54.546899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-26905e6d-bfd0-468c-8ac0-a6b35dc520ae None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:24:54.548141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-26905e6d-bfd0-468c-8ac0-a6b35dc520ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:54.557374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 770/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:24:54.711913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a226-a531-4e8a-a2d1-10cef4616c26 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:54.734328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a226-a531-4e8a-a2d1-10cef4616c26 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:54.740990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be184c3-6839-4686-9284-cf03b1fe416f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:54.741592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be184c3-6839-4686-9284-cf03b1fe416f service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:54.741875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be184c3-6839-4686-9284-cf03b1fe416f service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:54.742122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be184c3-6839-4686-9284-cf03b1fe416f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:54.750621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be184c3-6839-4686-9284-cf03b1fe416f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:54.752296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be184c3-6839-4686-9284-cf03b1fe416f service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:54.762608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 746/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:24:54.983160 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7154-68f2-4d8a-b54f-2b34c5ce363b None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:54.983436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7154-68f2-4d8a-b54f-2b34c5ce363b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:54.983690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7154-68f2-4d8a-b54f-2b34c5ce363b None None] PATH_INFO: `/v3` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:54.985107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 771/1517] 10.222.0.27 () {54 vars in 925 bytes} [Fri Sep 16 19:24:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:24:54.993203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc3832-b64c-446e-92a2-251fad45bc99 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:54.993488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc3832-b64c-446e-92a2-251fad45bc99 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:54.993760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc3832-b64c-446e-92a2-251fad45bc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:55.058095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-bcdc3832-b64c-446e-92a2-251fad45bc99 None None] MFA Rules not processed for user `d09ca68fdd5b4e178bcd6a5c8bccc4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:24:55.059303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-bcdc3832-b64c-446e-92a2-251fad45bc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:55.076852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:24:55.146464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 747/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Sep 16 19:24:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:04.025560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79a057-f0f2-4700-95a3-3293aca92ba7 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:04.026228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79a057-f0f2-4700-95a3-3293aca92ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:04.026385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79a057-f0f2-4700-95a3-3293aca92ba7 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:04.027795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 772/1519] 10.222.0.49 () {54 vars in 961 bytes} [Fri Sep 16 19:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:25:04.035246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76ef08-c639-4654-a97e-5968b2922f09 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:04.035730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76ef08-c639-4654-a97e-5968b2922f09 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:04.035730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76ef08-c639-4654-a97e-5968b2922f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:04.057459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ca76ef08-c639-4654-a97e-5968b2922f09 None None] MFA Rules not processed for user `d09ca68fdd5b4e178bcd6a5c8bccc4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:04.058709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ca76ef08-c639-4654-a97e-5968b2922f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:04.069021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 748/1520] 10.222.0.49 () {58 vars in 1058 bytes} [Fri Sep 16 19:25:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:04.077379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79a057-f0f2-4700-95a3-3293aca92ba7 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:04.099601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79a057-f0f2-4700-95a3-3293aca92ba7 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:04.107602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e6df0-3713-4d72-bfc9-5b9f9de7b13f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:04.108196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e6df0-3713-4d72-bfc9-5b9f9de7b13f service placement] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:04.108499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e6df0-3713-4d72-bfc9-5b9f9de7b13f service placement] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:04.108794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e6df0-3713-4d72-bfc9-5b9f9de7b13f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:04.117819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e6df0-3713-4d72-bfc9-5b9f9de7b13f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:04.119411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e6df0-3713-4d72-bfc9-5b9f9de7b13f service placement] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:04.129802 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 773/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:06.253329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27edc-b22d-4e33-92b7-bc1b42339e9f None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:06.254182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27edc-b22d-4e33-92b7-bc1b42339e9f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:06.254182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27edc-b22d-4e33-92b7-bc1b42339e9f None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:06.256331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:25:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:25:06.262620 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19113e4-3904-4f18-9344-456cbd9e41c9 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:06.263241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19113e4-3904-4f18-9344-456cbd9e41c9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:06.263362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19113e4-3904-4f18-9344-456cbd9e41c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:06.289144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-e19113e4-3904-4f18-9344-456cbd9e41c9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:06.290362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e19113e4-3904-4f18-9344-456cbd9e41c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:06.300098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:06.462998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a27edc-b22d-4e33-92b7-bc1b42339e9f None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:06.478533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a27edc-b22d-4e33-92b7-bc1b42339e9f None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:06.485264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76938c8-f650-4b96-baa3-20e24bb9b1ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:06.485850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76938c8-f650-4b96-baa3-20e24bb9b1ad service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:06.486126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76938c8-f650-4b96-baa3-20e24bb9b1ad service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:06.486391 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76938c8-f650-4b96-baa3-20e24bb9b1ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:06.494614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76938c8-f650-4b96-baa3-20e24bb9b1ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:06.496183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76938c8-f650-4b96-baa3-20e24bb9b1ad service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:06.505953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 750/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:07.574838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c640727-96ba-40b6-ae90-26ab99e05688 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:07.575893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c640727-96ba-40b6-ae90-26ab99e05688 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:07.575893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c640727-96ba-40b6-ae90-26ab99e05688 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:07.578164 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:25:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:25:07.587682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52752c-8b6a-4c2e-9f02-ba4c508b1352 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:07.588187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52752c-8b6a-4c2e-9f02-ba4c508b1352 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:07.588284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52752c-8b6a-4c2e-9f02-ba4c508b1352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:07.619038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2b52752c-8b6a-4c2e-9f02-ba4c508b1352 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:07.620786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2b52752c-8b6a-4c2e-9f02-ba4c508b1352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:07.631094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:25:07.793006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c640727-96ba-40b6-ae90-26ab99e05688 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:07.807908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c640727-96ba-40b6-ae90-26ab99e05688 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:07.815024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c18fc8-c8e8-477c-a25b-1a863b1e0241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:07.815627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c18fc8-c8e8-477c-a25b-1a863b1e0241 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:07.815906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c18fc8-c8e8-477c-a25b-1a863b1e0241 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:07.816178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c18fc8-c8e8-477c-a25b-1a863b1e0241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:07.824672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c18fc8-c8e8-477c-a25b-1a863b1e0241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:07.826466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c18fc8-c8e8-477c-a25b-1a863b1e0241 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:07.835800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 776/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:11.787799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc659b5-601f-44d7-b9b8-8659ae6c224e None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:11.788564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc659b5-601f-44d7-b9b8-8659ae6c224e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:11.788564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc659b5-601f-44d7-b9b8-8659ae6c224e None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:11.790784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:25:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:25:11.797303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aa447-b74c-444a-ae76-453c52fffe14 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:11.797765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aa447-b74c-444a-ae76-453c52fffe14 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:11.797863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aa447-b74c-444a-ae76-453c52fffe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:11.818969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-fe6aa447-b74c-444a-ae76-453c52fffe14 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:11.820184 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-fe6aa447-b74c-444a-ae76-453c52fffe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:11.829682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:12.115947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc659b5-601f-44d7-b9b8-8659ae6c224e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:12.118952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9bc659b5-601f-44d7-b9b8-8659ae6c224e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:12.204669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc659b5-601f-44d7-b9b8-8659ae6c224e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:12.208643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51375a-164c-4900-ba21-c12581f9dd1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:12.209250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51375a-164c-4900-ba21-c12581f9dd1a service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:12.209528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51375a-164c-4900-ba21-c12581f9dd1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:12.209800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51375a-164c-4900-ba21-c12581f9dd1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:12.219508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51375a-164c-4900-ba21-c12581f9dd1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:12.220991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51375a-164c-4900-ba21-c12581f9dd1a service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:12.230905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 753/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:14.389180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd74c8-9af2-415c-a219-b240ce695271 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:14.390179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd74c8-9af2-415c-a219-b240ce695271 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:14.390179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd74c8-9af2-415c-a219-b240ce695271 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:14.392218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:25:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:25:14.401205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041c25-2d21-40ef-880c-12e81cc3b9d6 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:14.401673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041c25-2d21-40ef-880c-12e81cc3b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:14.401777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041c25-2d21-40ef-880c-12e81cc3b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:14.423706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-eb041c25-2d21-40ef-880c-12e81cc3b9d6 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:14.424980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-eb041c25-2d21-40ef-880c-12e81cc3b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:14.434003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:14.729051 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd74c8-9af2-415c-a219-b240ce695271 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:14.731014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c0cd74c8-9af2-415c-a219-b240ce695271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:14.739115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=75 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:14.745903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd74c8-9af2-415c-a219-b240ce695271 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:14.749642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258f3a8-a0e3-479c-a786-39a13fd68f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:14.750245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258f3a8-a0e3-479c-a786-39a13fd68f89 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:14.750514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258f3a8-a0e3-479c-a786-39a13fd68f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:14.750799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258f3a8-a0e3-479c-a786-39a13fd68f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:14.760294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258f3a8-a0e3-479c-a786-39a13fd68f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:14.761782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258f3a8-a0e3-479c-a786-39a13fd68f89 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:14.771937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 779/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:25:18.398009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ecb0e-032a-4dc5-a349-334d07c28706 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:18.398957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ecb0e-032a-4dc5-a349-334d07c28706 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:18.398957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ecb0e-032a-4dc5-a349-334d07c28706 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:18.400289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:25:18.406751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822f9fd-7e88-4940-9ec3-d3885e245f84 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:18.407482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822f9fd-7e88-4940-9ec3-d3885e245f84 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:18.407657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822f9fd-7e88-4940-9ec3-d3885e245f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:18.433042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-a822f9fd-7e88-4940-9ec3-d3885e245f84 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:18.434248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a822f9fd-7e88-4940-9ec3-d3885e245f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:18.443732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:18.747082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ecb0e-032a-4dc5-a349-334d07c28706 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:18.750495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a23ecb0e-032a-4dc5-a349-334d07c28706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:18.830648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:18.845608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ecb0e-032a-4dc5-a349-334d07c28706 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:18.849258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b94103-e579-47a3-bd9b-8a4084f971bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:18.849857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b94103-e579-47a3-bd9b-8a4084f971bc service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:18.850132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b94103-e579-47a3-bd9b-8a4084f971bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:18.850399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b94103-e579-47a3-bd9b-8a4084f971bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:18.859545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b94103-e579-47a3-bd9b-8a4084f971bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:18.861080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b94103-e579-47a3-bd9b-8a4084f971bc service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:18.870414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 756/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:21.056152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157e6d-c6d6-496b-af14-446d53b39f3b None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:21.056992 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157e6d-c6d6-496b-af14-446d53b39f3b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:21.057159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157e6d-c6d6-496b-af14-446d53b39f3b None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:21.059729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:25:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:25:21.065273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045132-541e-4f17-8d34-9f095259be80 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:21.065731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045132-541e-4f17-8d34-9f095259be80 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:21.065841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045132-541e-4f17-8d34-9f095259be80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:21.085760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6c045132-541e-4f17-8d34-9f095259be80 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:21.086952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6c045132-541e-4f17-8d34-9f095259be80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:21.095604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:21.400287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06157e6d-c6d6-496b-af14-446d53b39f3b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:21.403534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-06157e6d-c6d6-496b-af14-446d53b39f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:21.425487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06157e6d-c6d6-496b-af14-446d53b39f3b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:21.430406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd2cae-6573-47b2-8fdd-d483bd13b705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:21.431124 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd2cae-6573-47b2-8fdd-d483bd13b705 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:21.431462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd2cae-6573-47b2-8fdd-d483bd13b705 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:21.431793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd2cae-6573-47b2-8fdd-d483bd13b705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:21.443467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd2cae-6573-47b2-8fdd-d483bd13b705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:21.445314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd2cae-6573-47b2-8fdd-d483bd13b705 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:21.457642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 782/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:31.080909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=11 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:31.452194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=14 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:44.847663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cb44c-33c3-4097-abef-11c4e90caa94 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:44.848343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cb44c-33c3-4097-abef-11c4e90caa94 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:44.848343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cb44c-33c3-4097-abef-11c4e90caa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:44.877066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-188cb44c-33c3-4097-abef-11c4e90caa94 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:44.878313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-188cb44c-33c3-4097-abef-11c4e90caa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:44.891111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 758/1540] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:44.901071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0113-d022-4ea9-a298-96278304c58f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:44.902329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0113-d022-4ea9-a298-96278304c58f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:44.902768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0113-d022-4ea9-a298-96278304c58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:44.937902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-cc9b0113-d022-4ea9-a298-96278304c58f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:44.939505 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cc9b0113-d022-4ea9-a298-96278304c58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:44.954855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 783/1541] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:44.959698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cb44c-33c3-4097-abef-11c4e90caa94 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:44.975187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cb44c-33c3-4097-abef-11c4e90caa94 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:44.985285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825c29f-d629-4976-9a60-4b2fd44363f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:44.986202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825c29f-d629-4976-9a60-4b2fd44363f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:44.986484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825c29f-d629-4976-9a60-4b2fd44363f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:44.986760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825c29f-d629-4976-9a60-4b2fd44363f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:44.987428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825c29f-d629-4976-9a60-4b2fd44363f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:26:44.987729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825c29f-d629-4976-9a60-4b2fd44363f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:44.989567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825c29f-d629-4976-9a60-4b2fd44363f4 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.011396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 759/1542] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:26:45.020016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b0113-d022-4ea9-a298-96278304c58f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.032727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b0113-d022-4ea9-a298-96278304c58f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.038849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9d401-fb0d-4128-8e84-5b184adf4221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.039941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9d401-fb0d-4128-8e84-5b184adf4221 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.040458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9d401-fb0d-4128-8e84-5b184adf4221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.040962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9d401-fb0d-4128-8e84-5b184adf4221 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.041837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9d401-fb0d-4128-8e84-5b184adf4221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.044046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9d401-fb0d-4128-8e84-5b184adf4221 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.105855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 784/1543] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:45.111620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825c29f-d629-4976-9a60-4b2fd44363f4 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.128605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825c29f-d629-4976-9a60-4b2fd44363f4 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.145609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b3836-54ca-43f5-ac54-ad622721ec84 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.145917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b3836-54ca-43f5-ac54-ad622721ec84 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.146284 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b3836-54ca-43f5-ac54-ad622721ec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.179845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-9c2b3836-54ca-43f5-ac54-ad622721ec84 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.181390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9c2b3836-54ca-43f5-ac54-ad622721ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.248421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c767fd-f36a-457d-bb1f-fa9bdd674603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.249511 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c767fd-f36a-457d-bb1f-fa9bdd674603 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.249794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c767fd-f36a-457d-bb1f-fa9bdd674603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.250068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c767fd-f36a-457d-bb1f-fa9bdd674603 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.250738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c767fd-f36a-457d-bb1f-fa9bdd674603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.254394 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c767fd-f36a-457d-bb1f-fa9bdd674603 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.302744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 760/1544] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:45.303990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889644-391e-49ae-b8ed-1645fa2ed077 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.304277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889644-391e-49ae-b8ed-1645fa2ed077 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.304570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889644-391e-49ae-b8ed-1645fa2ed077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.309678 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 785/1545] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.311676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36145-f45a-4b80-9883-78a2f2953ff4 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.311962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36145-f45a-4b80-9883-78a2f2953ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.312235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36145-f45a-4b80-9883-78a2f2953ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.331986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-85889644-391e-49ae-b8ed-1645fa2ed077 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.334090 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-85889644-391e-49ae-b8ed-1645fa2ed077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.338942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-20d36145-f45a-4b80-9883-78a2f2953ff4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.340241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-20d36145-f45a-4b80-9883-78a2f2953ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.343603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 761/1546] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.344760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c14e6-b3a3-45bc-b843-8bd0db97ab89 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.345039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c14e6-b3a3-45bc-b843-8bd0db97ab89 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.345308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c14e6-b3a3-45bc-b843-8bd0db97ab89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.353952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 786/1547] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.355046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506bf06-b3dc-49d8-8ef7-6a75ca44c668 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.355329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506bf06-b3dc-49d8-8ef7-6a75ca44c668 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.355603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506bf06-b3dc-49d8-8ef7-6a75ca44c668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.368737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-147c14e6-b3a3-45bc-b843-8bd0db97ab89 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.371130 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-147c14e6-b3a3-45bc-b843-8bd0db97ab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.380418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 762/1548] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.381763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9b52-b51b-4a41-9ec0-e7995d489a49 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.381891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3506bf06-b3dc-49d8-8ef7-6a75ca44c668 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.382152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9b52-b51b-4a41-9ec0-e7995d489a49 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.382482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9b52-b51b-4a41-9ec0-e7995d489a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.383009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3506bf06-b3dc-49d8-8ef7-6a75ca44c668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.400463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 787/1549] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.400463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506bf06-b3dc-49d8-8ef7-6a75ca44c668 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.409099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506bf06-b3dc-49d8-8ef7-6a75ca44c668 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.409517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-1acd9b52-b51b-4a41-9ec0-e7995d489a49 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.410938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-1acd9b52-b51b-4a41-9ec0-e7995d489a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.414053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0da99-9f02-41c4-b30a-d03d641f5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.414728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0da99-9f02-41c4-b30a-d03d641f5018 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.415074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0da99-9f02-41c4-b30a-d03d641f5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.415405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0da99-9f02-41c4-b30a-d03d641f5018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.416160 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0da99-9f02-41c4-b30a-d03d641f5018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.417998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0da99-9f02-41c4-b30a-d03d641f5018 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.420180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 763/1550] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.421401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e6845-f76a-4790-bb75-c03430ea6329 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.421751 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e6845-f76a-4790-bb75-c03430ea6329 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.422093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e6845-f76a-4790-bb75-c03430ea6329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.429526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 788/1551] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:45.430806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc859cc0-b1b6-4ad4-8464-da22aee66df0 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.431186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc859cc0-b1b6-4ad4-8464-da22aee66df0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.431589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc859cc0-b1b6-4ad4-8464-da22aee66df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.454437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-684e6845-f76a-4790-bb75-c03430ea6329 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.455660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-684e6845-f76a-4790-bb75-c03430ea6329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.458535 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-cc859cc0-b1b6-4ad4-8464-da22aee66df0 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.460249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cc859cc0-b1b6-4ad4-8464-da22aee66df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.464156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 764/1552] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.466007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677bd8-e0b3-4aae-ad6b-50e909424145 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.466007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677bd8-e0b3-4aae-ad6b-50e909424145 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.466007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677bd8-e0b3-4aae-ad6b-50e909424145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.473399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 789/1553] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.475422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a63ca7-5723-478e-b70a-ed3d1abe577f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.475837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a63ca7-5723-478e-b70a-ed3d1abe577f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.476229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a63ca7-5723-478e-b70a-ed3d1abe577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.486014 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ba677bd8-e0b3-4aae-ad6b-50e909424145 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.487212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ba677bd8-e0b3-4aae-ad6b-50e909424145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.495302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 765/1554] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.496400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a2a5-ecc2-462c-b578-24c13187cb59 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.496694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a2a5-ecc2-462c-b578-24c13187cb59 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.497031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a2a5-ecc2-462c-b578-24c13187cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.506725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-88a63ca7-5723-478e-b70a-ed3d1abe577f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.507983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-88a63ca7-5723-478e-b70a-ed3d1abe577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.517633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 790/1555] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.518448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-9e93a2a5-ecc2-462c-b578-24c13187cb59 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.519067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6943a-1ce0-4132-b061-b846d297674e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.519355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6943a-1ce0-4132-b061-b846d297674e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.519618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9e93a2a5-ecc2-462c-b578-24c13187cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.519737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6943a-1ce0-4132-b061-b846d297674e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.528597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 766/1556] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.528801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93a2a5-ecc2-462c-b578-24c13187cb59 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.539099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93a2a5-ecc2-462c-b578-24c13187cb59 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.541491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3db6943a-1ce0-4132-b061-b846d297674e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.542704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3db6943a-1ce0-4132-b061-b846d297674e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.543623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72aa0dc-066a-49d7-b85e-8b0a1b817017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.544257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aa0dc-066a-49d7-b85e-8b0a1b817017 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.544567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aa0dc-066a-49d7-b85e-8b0a1b817017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.544898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aa0dc-066a-49d7-b85e-8b0a1b817017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.545495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aa0dc-066a-49d7-b85e-8b0a1b817017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.547107 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aa0dc-066a-49d7-b85e-8b0a1b817017 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.551503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 791/1557] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.552732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543593-0f30-4147-bd5c-c3960a550d98 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.553072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543593-0f30-4147-bd5c-c3960a550d98 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.553282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543593-0f30-4147-bd5c-c3960a550d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.560439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 767/1558] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:45.561253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72aa0dc-066a-49d7-b85e-8b0a1b817017 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.570911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72aa0dc-066a-49d7-b85e-8b0a1b817017 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.575837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b98195-04bf-4c3c-836c-0f975652160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.576015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ef543593-0f30-4147-bd5c-c3960a550d98 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.576434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b98195-04bf-4c3c-836c-0f975652160f admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.576737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b98195-04bf-4c3c-836c-0f975652160f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.577009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b98195-04bf-4c3c-836c-0f975652160f admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.577244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ef543593-0f30-4147-bd5c-c3960a550d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.577635 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b98195-04bf-4c3c-836c-0f975652160f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:26:45.577933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b98195-04bf-4c3c-836c-0f975652160f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.579523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b98195-04bf-4c3c-836c-0f975652160f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.585619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 792/1559] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.586399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef543593-0f30-4147-bd5c-c3960a550d98 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.592136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 768/1560] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:26:45.593494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b98195-04bf-4c3c-836c-0f975652160f admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.602046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef543593-0f30-4147-bd5c-c3960a550d98 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.603091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b98195-04bf-4c3c-836c-0f975652160f admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.607380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490586a-f0fb-4ba4-842c-79de728001b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.607941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5ba9d-d719-48c3-b72e-e51af5026831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.608134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490586a-f0fb-4ba4-842c-79de728001b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.608517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490586a-f0fb-4ba4-842c-79de728001b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.608635 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5ba9d-d719-48c3-b72e-e51af5026831 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.608832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5ba9d-d719-48c3-b72e-e51af5026831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.608975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490586a-f0fb-4ba4-842c-79de728001b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.609160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5ba9d-d719-48c3-b72e-e51af5026831 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.609624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490586a-f0fb-4ba4-842c-79de728001b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:26:45.609803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5ba9d-d719-48c3-b72e-e51af5026831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:26:45.609912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490586a-f0fb-4ba4-842c-79de728001b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.610113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5ba9d-d719-48c3-b72e-e51af5026831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.610944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: WARNING py.warnings [None req-9490586a-f0fb-4ba4-842c-79de728001b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:26:45.610944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: warnings.warn(msg) Sep 16 19:26:45.610944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: Sep 16 19:26:45.611735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5ba9d-d719-48c3-b72e-e51af5026831 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.611859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490586a-f0fb-4ba4-842c-79de728001b7 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.623742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 769/1561] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:26:45.624139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 793/1562] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:26:45.624579 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5ba9d-d719-48c3-b72e-e51af5026831 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.631603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490586a-f0fb-4ba4-842c-79de728001b7 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.641223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490586a-f0fb-4ba4-842c-79de728001b7 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.642696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5ba9d-d719-48c3-b72e-e51af5026831 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.646245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b5827-77b3-45da-91a2-48de8db098d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.646854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b5827-77b3-45da-91a2-48de8db098d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.647136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b5827-77b3-45da-91a2-48de8db098d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.647413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b5827-77b3-45da-91a2-48de8db098d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.647849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ae75-9c10-412f-99d8-8bf83f0a3e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.648087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b5827-77b3-45da-91a2-48de8db098d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:26:45.648478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b5827-77b3-45da-91a2-48de8db098d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.648596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ae75-9c10-412f-99d8-8bf83f0a3e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.648782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ae75-9c10-412f-99d8-8bf83f0a3e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.649051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ae75-9c10-412f-99d8-8bf83f0a3e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.649692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ae75-9c10-412f-99d8-8bf83f0a3e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:26:45.649989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ae75-9c10-412f-99d8-8bf83f0a3e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.650093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b5827-77b3-45da-91a2-48de8db098d6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.651577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ae75-9c10-412f-99d8-8bf83f0a3e45 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.662301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 794/1563] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:26:45.663107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b5827-77b3-45da-91a2-48de8db098d6 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.672762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 770/1564] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:26:45.672762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ae75-9c10-412f-99d8-8bf83f0a3e45 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.678516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b5827-77b3-45da-91a2-48de8db098d6 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.682638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ae75-9c10-412f-99d8-8bf83f0a3e45 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.683223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5fd6f-be13-4706-87cf-f804355b2e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.683829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5fd6f-be13-4706-87cf-f804355b2e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.684096 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5fd6f-be13-4706-87cf-f804355b2e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.684458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5fd6f-be13-4706-87cf-f804355b2e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.685293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5fd6f-be13-4706-87cf-f804355b2e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:26:45.685601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5fd6f-be13-4706-87cf-f804355b2e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.687220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5fd6f-be13-4706-87cf-f804355b2e4f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.687786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67629-464e-4c4b-8ce4-51b5aed4a8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.688693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67629-464e-4c4b-8ce4-51b5aed4a8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.688886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67629-464e-4c4b-8ce4-51b5aed4a8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.689228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67629-464e-4c4b-8ce4-51b5aed4a8fd admin admin] PATH_INFO: `/v3/projects/1983ce4dc9bd4050a2399d9f62d3e871/users/92f0c702f8ce49a99a10175b0ce68685/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.698731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 795/1565] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:26:45.706322 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b02d8-f5d9-4a5f-b2f8-d89dd8fe7e4e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.706322 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b02d8-f5d9-4a5f-b2f8-d89dd8fe7e4e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.706322 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b02d8-f5d9-4a5f-b2f8-d89dd8fe7e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.707506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67629-464e-4c4b-8ce4-51b5aed4a8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1983ce4dc9bd4050a2399d9f62d3e871, user_id=92f0c702f8ce49a99a10175b0ce68685, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.708796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: WARNING py.warnings [None req-0cb67629-464e-4c4b-8ce4-51b5aed4a8fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:26:45.708796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: warnings.warn(msg) Sep 16 19:26:45.708796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: Sep 16 19:26:45.710760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67629-464e-4c4b-8ce4-51b5aed4a8fd admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.720587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-972b02d8-f5d9-4a5f-b2f8-d89dd8fe7e4e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:45.722120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-972b02d8-f5d9-4a5f-b2f8-d89dd8fe7e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:45.725534 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 771/1566] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:45 2022] PUT /identity/v3/projects/1983ce4dc9bd4050a2399d9f62d3e871/users/92f0c702f8ce49a99a10175b0ce68685/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:45.726324 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67629-464e-4c4b-8ce4-51b5aed4a8fd admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.743403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:45.758151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:45.792315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 796/1567] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:45.793172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b02d8-f5d9-4a5f-b2f8-d89dd8fe7e4e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.794354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67629-464e-4c4b-8ce4-51b5aed4a8fd admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.799048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1f12b-f95e-46f4-8db5-3340484875fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.799659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1f12b-f95e-46f4-8db5-3340484875fd admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.799942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1f12b-f95e-46f4-8db5-3340484875fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.800211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1f12b-f95e-46f4-8db5-3340484875fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.800877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1f12b-f95e-46f4-8db5-3340484875fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.801894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: WARNING py.warnings [None req-10e1f12b-f95e-46f4-8db5-3340484875fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:26:45.801894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: warnings.warn(msg) Sep 16 19:26:45.801894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: Sep 16 19:26:45.803182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1f12b-f95e-46f4-8db5-3340484875fd admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.805027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b02d8-f5d9-4a5f-b2f8-d89dd8fe7e4e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.809733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26828ae-a0df-4c99-af2a-bbb81f61be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.810325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26828ae-a0df-4c99-af2a-bbb81f61be68 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.810603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26828ae-a0df-4c99-af2a-bbb81f61be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.810877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26828ae-a0df-4c99-af2a-bbb81f61be68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.811516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26828ae-a0df-4c99-af2a-bbb81f61be68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.813501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26828ae-a0df-4c99-af2a-bbb81f61be68 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.837225 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 772/1568] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:45.837225 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1f12b-f95e-46f4-8db5-3340484875fd admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.841824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 797/1569] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:45.842862 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26828ae-a0df-4c99-af2a-bbb81f61be68 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.902163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1f12b-f95e-46f4-8db5-3340484875fd admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.905570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26828ae-a0df-4c99-af2a-bbb81f61be68 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:45.906970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc1a77-99b6-4cf8-bd97-d051ece26a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.907588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc1a77-99b6-4cf8-bd97-d051ece26a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.907870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc1a77-99b6-4cf8-bd97-d051ece26a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.908144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc1a77-99b6-4cf8-bd97-d051ece26a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.908834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc1a77-99b6-4cf8-bd97-d051ece26a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.910589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23e9bc-129b-499e-9a57-1eafd843b4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:45.910750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc1a77-99b6-4cf8-bd97-d051ece26a3a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.911195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23e9bc-129b-499e-9a57-1eafd843b4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:45.911467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23e9bc-129b-499e-9a57-1eafd843b4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:45.911731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23e9bc-129b-499e-9a57-1eafd843b4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:45.912363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23e9bc-129b-499e-9a57-1eafd843b4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:45.914289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23e9bc-129b-499e-9a57-1eafd843b4d5 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:45.942708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 773/1570] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:45.942708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc1a77-99b6-4cf8-bd97-d051ece26a3a admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:45.943334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 798/1571] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:45.943998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23e9bc-129b-499e-9a57-1eafd843b4d5 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.003991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc1a77-99b6-4cf8-bd97-d051ece26a3a admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.008131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23e9bc-129b-499e-9a57-1eafd843b4d5 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.008746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016c9e2-e088-4a2e-82ab-72a9dfa26018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.009365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016c9e2-e088-4a2e-82ab-72a9dfa26018 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.009651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016c9e2-e088-4a2e-82ab-72a9dfa26018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.010087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016c9e2-e088-4a2e-82ab-72a9dfa26018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.010736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016c9e2-e088-4a2e-82ab-72a9dfa26018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.013087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016c9e2-e088-4a2e-82ab-72a9dfa26018 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.013282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a2407-9c1e-44ee-9f69-c7f3d4161823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.013716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a2407-9c1e-44ee-9f69-c7f3d4161823 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.013998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a2407-9c1e-44ee-9f69-c7f3d4161823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.014269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a2407-9c1e-44ee-9f69-c7f3d4161823 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.014907 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a2407-9c1e-44ee-9f69-c7f3d4161823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.016868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a2407-9c1e-44ee-9f69-c7f3d4161823 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.042166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 774/1572] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:46.043247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42a577-9624-417c-8216-ed389838238e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.043592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42a577-9624-417c-8216-ed389838238e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.043883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42a577-9624-417c-8216-ed389838238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.050309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 799/1573] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:45 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:46.050309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a2407-9c1e-44ee-9f69-c7f3d4161823 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.062726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-de42a577-9624-417c-8216-ed389838238e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:46.063920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-de42a577-9624-417c-8216-ed389838238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:46.069123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:46.075242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:46.112591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a2407-9c1e-44ee-9f69-c7f3d4161823 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.117297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4560d5-559b-41e4-ae23-bfb9d4b6c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.117940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4560d5-559b-41e4-ae23-bfb9d4b6c5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.118389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4560d5-559b-41e4-ae23-bfb9d4b6c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.118668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4560d5-559b-41e4-ae23-bfb9d4b6c5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.119314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4560d5-559b-41e4-ae23-bfb9d4b6c5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:26:46.119614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4560d5-559b-41e4-ae23-bfb9d4b6c5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.121276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4560d5-559b-41e4-ae23-bfb9d4b6c5e8 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.126126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 775/1574] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:46.126957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42a577-9624-417c-8216-ed389838238e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.140742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 800/1575] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:26:46.140742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4560d5-559b-41e4-ae23-bfb9d4b6c5e8 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.141037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42a577-9624-417c-8216-ed389838238e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.141677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd2c56-0ed3-4431-b05f-aad12af4007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.142676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd2c56-0ed3-4431-b05f-aad12af4007d admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.142962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd2c56-0ed3-4431-b05f-aad12af4007d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.143237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd2c56-0ed3-4431-b05f-aad12af4007d admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.143871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd2c56-0ed3-4431-b05f-aad12af4007d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.145857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd2c56-0ed3-4431-b05f-aad12af4007d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.151318 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4560d5-559b-41e4-ae23-bfb9d4b6c5e8 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.156882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4695b4-a609-4078-9d1c-70f8a2a77dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.157536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4695b4-a609-4078-9d1c-70f8a2a77dad admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.157859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4695b4-a609-4078-9d1c-70f8a2a77dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.158071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4695b4-a609-4078-9d1c-70f8a2a77dad admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.158702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4695b4-a609-4078-9d1c-70f8a2a77dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.159904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: WARNING py.warnings [None req-8d4695b4-a609-4078-9d1c-70f8a2a77dad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:26:46.159904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: warnings.warn(msg) Sep 16 19:26:46.159904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: Sep 16 19:26:46.161385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4695b4-a609-4078-9d1c-70f8a2a77dad admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.172230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 776/1576] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:46 2022] POST /identity/v3/users => generated 284 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:46.172230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd2c56-0ed3-4431-b05f-aad12af4007d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.180488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd2c56-0ed3-4431-b05f-aad12af4007d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.185358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 801/1577] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:46 2022] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:46.186084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd1150-63ce-4209-a004-1efc5b726940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.186219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4695b4-a609-4078-9d1c-70f8a2a77dad admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.186800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd1150-63ce-4209-a004-1efc5b726940 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.187136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd1150-63ce-4209-a004-1efc5b726940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.187468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd1150-63ce-4209-a004-1efc5b726940 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.188161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd1150-63ce-4209-a004-1efc5b726940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.190213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd1150-63ce-4209-a004-1efc5b726940 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.198313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4695b4-a609-4078-9d1c-70f8a2a77dad admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.204062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c575ae-e233-435c-ac1e-8024f806fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.204840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c575ae-e233-435c-ac1e-8024f806fe1c admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.205130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c575ae-e233-435c-ac1e-8024f806fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.205386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c575ae-e233-435c-ac1e-8024f806fe1c admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.206232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c575ae-e233-435c-ac1e-8024f806fe1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.208500 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c575ae-e233-435c-ac1e-8024f806fe1c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.213812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 777/1578] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:46 2022] POST /identity/v3/users => generated 303 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:46.217540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd1150-63ce-4209-a004-1efc5b726940 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.228725 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd1150-63ce-4209-a004-1efc5b726940 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.231590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 802/1579] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:46 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:46.232623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c575ae-e233-435c-ac1e-8024f806fe1c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.236600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a7eb-f3db-4f1e-8053-a7d56efb0074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.237262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a7eb-f3db-4f1e-8053-a7d56efb0074 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.237541 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a7eb-f3db-4f1e-8053-a7d56efb0074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.237838 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a7eb-f3db-4f1e-8053-a7d56efb0074 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.238469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834a7eb-f3db-4f1e-8053-a7d56efb0074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.240462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834a7eb-f3db-4f1e-8053-a7d56efb0074 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.242012 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c575ae-e233-435c-ac1e-8024f806fe1c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.246607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde386f-d7bf-4b0d-95b8-dc6ae3a2a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.247480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde386f-d7bf-4b0d-95b8-dc6ae3a2a9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.247782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde386f-d7bf-4b0d-95b8-dc6ae3a2a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.248055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde386f-d7bf-4b0d-95b8-dc6ae3a2a9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.248718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde386f-d7bf-4b0d-95b8-dc6ae3a2a9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.250885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde386f-d7bf-4b0d-95b8-dc6ae3a2a9e2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.266872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 778/1580] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:46 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:46.268220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a7eb-f3db-4f1e-8053-a7d56efb0074 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.278281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 803/1581] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:46 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:46.279089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde386f-d7bf-4b0d-95b8-dc6ae3a2a9e2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.288629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde386f-d7bf-4b0d-95b8-dc6ae3a2a9e2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.293241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa843c7d-e7fe-4ba3-b5ee-bb0dc1580d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.293865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa843c7d-e7fe-4ba3-b5ee-bb0dc1580d8a admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.294117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa843c7d-e7fe-4ba3-b5ee-bb0dc1580d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.294426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa843c7d-e7fe-4ba3-b5ee-bb0dc1580d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.295053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa843c7d-e7fe-4ba3-b5ee-bb0dc1580d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.297033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa843c7d-e7fe-4ba3-b5ee-bb0dc1580d8a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.326676 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 804/1582] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:46 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:46.327437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa843c7d-e7fe-4ba3-b5ee-bb0dc1580d8a admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.330192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a7eb-f3db-4f1e-8053-a7d56efb0074 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.380705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54840ae9-7151-4589-ace5-e71920dacac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.381319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54840ae9-7151-4589-ace5-e71920dacac2 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.381598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54840ae9-7151-4589-ace5-e71920dacac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.381864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54840ae9-7151-4589-ace5-e71920dacac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.389942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa843c7d-e7fe-4ba3-b5ee-bb0dc1580d8a admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.391341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54840ae9-7151-4589-ace5-e71920dacac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.393238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54840ae9-7151-4589-ace5-e71920dacac2 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.394968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961da0a-cb4f-407e-9f76-8bc9a56b9e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.395585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961da0a-cb4f-407e-9f76-8bc9a56b9e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.395863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961da0a-cb4f-407e-9f76-8bc9a56b9e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.396137 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961da0a-cb4f-407e-9f76-8bc9a56b9e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.397747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961da0a-cb4f-407e-9f76-8bc9a56b9e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.398471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961da0a-cb4f-407e-9f76-8bc9a56b9e55 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.403435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 779/1583] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:46.404445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54840ae9-7151-4589-ace5-e71920dacac2 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.413161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 805/1584] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.413161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961da0a-cb4f-407e-9f76-8bc9a56b9e55 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.419520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54840ae9-7151-4589-ace5-e71920dacac2 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.421201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961da0a-cb4f-407e-9f76-8bc9a56b9e55 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.426983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a42a2-9153-4753-bd46-67f687cc0a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.427719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a42a2-9153-4753-bd46-67f687cc0a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.428061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047cd33-ff58-430b-93cd-6b3c5a765d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.428209 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a42a2-9153-4753-bd46-67f687cc0a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.428477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a42a2-9153-4753-bd46-67f687cc0a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.428791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047cd33-ff58-430b-93cd-6b3c5a765d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.429096 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047cd33-ff58-430b-93cd-6b3c5a765d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.429291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a42a2-9153-4753-bd46-67f687cc0a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.429448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047cd33-ff58-430b-93cd-6b3c5a765d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.430136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047cd33-ff58-430b-93cd-6b3c5a765d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.430942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a42a2-9153-4753-bd46-67f687cc0a92 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.432324 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047cd33-ff58-430b-93cd-6b3c5a765d63 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.443571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 806/1585] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.446924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 780/1586] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.447069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047cd33-ff58-430b-93cd-6b3c5a765d63 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.447169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a42a2-9153-4753-bd46-67f687cc0a92 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.455242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047cd33-ff58-430b-93cd-6b3c5a765d63 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.460087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a42a2-9153-4753-bd46-67f687cc0a92 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.460253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dec23-cd46-4d6b-8e8d-62bcd6737752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.460844 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dec23-cd46-4d6b-8e8d-62bcd6737752 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.461122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dec23-cd46-4d6b-8e8d-62bcd6737752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.461393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dec23-cd46-4d6b-8e8d-62bcd6737752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.462043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dec23-cd46-4d6b-8e8d-62bcd6737752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.464044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dec23-cd46-4d6b-8e8d-62bcd6737752 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.466646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a374211-0a83-4cdf-ab6a-6a724e7c1802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.467379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a374211-0a83-4cdf-ab6a-6a724e7c1802 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.467646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a374211-0a83-4cdf-ab6a-6a724e7c1802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.467936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a374211-0a83-4cdf-ab6a-6a724e7c1802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.468615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a374211-0a83-4cdf-ab6a-6a724e7c1802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.470212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a374211-0a83-4cdf-ab6a-6a724e7c1802 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.471656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:46.480156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 807/1587] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.482126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dec23-cd46-4d6b-8e8d-62bcd6737752 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.490500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 781/1588] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.491338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a374211-0a83-4cdf-ab6a-6a724e7c1802 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.496210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dec23-cd46-4d6b-8e8d-62bcd6737752 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.502595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66eacc-615f-4864-8d55-2ddf4f98628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.502788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a374211-0a83-4cdf-ab6a-6a724e7c1802 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.503412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66eacc-615f-4864-8d55-2ddf4f98628c admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.503826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66eacc-615f-4864-8d55-2ddf4f98628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.504228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66eacc-615f-4864-8d55-2ddf4f98628c admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.505107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66eacc-615f-4864-8d55-2ddf4f98628c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.506843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66eacc-615f-4864-8d55-2ddf4f98628c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.508059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f5fb4-9eb5-48f7-ac5a-6b0cce04d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.508832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f5fb4-9eb5-48f7-ac5a-6b0cce04d846 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.509072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f5fb4-9eb5-48f7-ac5a-6b0cce04d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.509366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f5fb4-9eb5-48f7-ac5a-6b0cce04d846 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.510270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f5fb4-9eb5-48f7-ac5a-6b0cce04d846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.512280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f5fb4-9eb5-48f7-ac5a-6b0cce04d846 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.519988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 808/1589] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.521018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66eacc-615f-4864-8d55-2ddf4f98628c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.527301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:46.532037 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66eacc-615f-4864-8d55-2ddf4f98628c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.538833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b379-35fc-4753-9a54-927319e5e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.539728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b379-35fc-4753-9a54-927319e5e564 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.540299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b379-35fc-4753-9a54-927319e5e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.540707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b379-35fc-4753-9a54-927319e5e564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.541607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b379-35fc-4753-9a54-927319e5e564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.542332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 782/1590] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:46 2022] POST /identity/v3/users => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:46.543035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f5fb4-9eb5-48f7-ac5a-6b0cce04d846 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.543516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b379-35fc-4753-9a54-927319e5e564 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.554429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f5fb4-9eb5-48f7-ac5a-6b0cce04d846 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.555490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 809/1591] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.556319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b379-35fc-4753-9a54-927319e5e564 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.564550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669b0ba-c435-41c8-8682-8b7eeaf96ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.565418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669b0ba-c435-41c8-8682-8b7eeaf96ded admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.565921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669b0ba-c435-41c8-8682-8b7eeaf96ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.566347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669b0ba-c435-41c8-8682-8b7eeaf96ded admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.566806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b379-35fc-4753-9a54-927319e5e564 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.567501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669b0ba-c435-41c8-8682-8b7eeaf96ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.569211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669b0ba-c435-41c8-8682-8b7eeaf96ded admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.574381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560faf5-cce1-41d6-a2f0-68bf8cc809fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.576011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560faf5-cce1-41d6-a2f0-68bf8cc809fb admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.576466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560faf5-cce1-41d6-a2f0-68bf8cc809fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.576932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560faf5-cce1-41d6-a2f0-68bf8cc809fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.577885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560faf5-cce1-41d6-a2f0-68bf8cc809fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.580640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560faf5-cce1-41d6-a2f0-68bf8cc809fb admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.584835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 783/1592] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.584835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669b0ba-c435-41c8-8682-8b7eeaf96ded admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.595366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669b0ba-c435-41c8-8682-8b7eeaf96ded admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.597627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 810/1593] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.599153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560faf5-cce1-41d6-a2f0-68bf8cc809fb admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.608687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b6f8f-c256-4201-83b5-0da8914764c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.610366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b6f8f-c256-4201-83b5-0da8914764c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.610679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b6f8f-c256-4201-83b5-0da8914764c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.610946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b6f8f-c256-4201-83b5-0da8914764c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.611661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b6f8f-c256-4201-83b5-0da8914764c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.614035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b6f8f-c256-4201-83b5-0da8914764c6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.615384 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560faf5-cce1-41d6-a2f0-68bf8cc809fb admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.620645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ef1a-20e2-4cdc-ab50-258147c16e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.621269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ef1a-20e2-4cdc-ab50-258147c16e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.621605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ef1a-20e2-4cdc-ab50-258147c16e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.621968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ef1a-20e2-4cdc-ab50-258147c16e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.622690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6ef1a-20e2-4cdc-ab50-258147c16e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.624498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6ef1a-20e2-4cdc-ab50-258147c16e3b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.631092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 784/1594] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.631092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b6f8f-c256-4201-83b5-0da8914764c6 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.639393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 811/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.640626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ef1a-20e2-4cdc-ab50-258147c16e3b admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.645092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b6f8f-c256-4201-83b5-0da8914764c6 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.650901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f823f-132a-4f00-a05f-0622fd8f28c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.651517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f823f-132a-4f00-a05f-0622fd8f28c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.651797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f823f-132a-4f00-a05f-0622fd8f28c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.652068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f823f-132a-4f00-a05f-0622fd8f28c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.652713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ef1a-20e2-4cdc-ab50-258147c16e3b admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.652839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f823f-132a-4f00-a05f-0622fd8f28c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.655067 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f823f-132a-4f00-a05f-0622fd8f28c8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.657481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d34c4-c44c-44c4-9658-6f1bb502c4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.658137 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d34c4-c44c-44c4-9658-6f1bb502c4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.658420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d34c4-c44c-44c4-9658-6f1bb502c4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.658681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d34c4-c44c-44c4-9658-6f1bb502c4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.659518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d34c4-c44c-44c4-9658-6f1bb502c4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.661239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d34c4-c44c-44c4-9658-6f1bb502c4e1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.670570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 785/1596] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.670570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f823f-132a-4f00-a05f-0622fd8f28c8 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.674530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 812/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:46.678390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d34c4-c44c-44c4-9658-6f1bb502c4e1 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.679896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f823f-132a-4f00-a05f-0622fd8f28c8 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.686188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3245d78-b090-4d76-9616-b42548bae9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.687142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3245d78-b090-4d76-9616-b42548bae9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.687467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3245d78-b090-4d76-9616-b42548bae9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.687696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3245d78-b090-4d76-9616-b42548bae9ac admin admin] PATH_INFO: `/v3/projects/60d215b03a484e52a042ffe1bb6115e4/users/098075c218cb4e6dbfd873e9443a38c1/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.689292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d34c4-c44c-44c4-9658-6f1bb502c4e1 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.697893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfd502-4a89-4c11-8868-324828c5a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.698621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd502-4a89-4c11-8868-324828c5a217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.698896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd502-4a89-4c11-8868-324828c5a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.699215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd502-4a89-4c11-8868-324828c5a217 admin admin] PATH_INFO: `/v3/projects/04946d4a1ff64961acfa93fa3e5e0fd4/users/e10a141a166449b78f1959e9331e6d73/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.705543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3245d78-b090-4d76-9616-b42548bae9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d215b03a484e52a042ffe1bb6115e4, user_id=098075c218cb4e6dbfd873e9443a38c1, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.708525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3245d78-b090-4d76-9616-b42548bae9ac admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.717522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfd502-4a89-4c11-8868-324828c5a217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04946d4a1ff64961acfa93fa3e5e0fd4, user_id=e10a141a166449b78f1959e9331e6d73, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.721082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfd502-4a89-4c11-8868-324828c5a217 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.725145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 786/1598] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:46 2022] PUT /identity/v3/projects/60d215b03a484e52a042ffe1bb6115e4/users/098075c218cb4e6dbfd873e9443a38c1/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:46.725320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3245d78-b090-4d76-9616-b42548bae9ac admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.740222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 813/1599] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:46 2022] PUT /identity/v3/projects/04946d4a1ff64961acfa93fa3e5e0fd4/users/e10a141a166449b78f1959e9331e6d73/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:46.743935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfd502-4a89-4c11-8868-324828c5a217 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.799902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3245d78-b090-4d76-9616-b42548bae9ac admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.852509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfd502-4a89-4c11-8868-324828c5a217 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.859320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ebce-a719-4b1f-b38c-a06000539ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.860510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ebce-a719-4b1f-b38c-a06000539ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.861626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ebce-a719-4b1f-b38c-a06000539ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.862050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ebce-a719-4b1f-b38c-a06000539ce1 admin admin] PATH_INFO: `/v3/projects/233a5a65caee4bc3be172bbd02c4efff/users/4160745043014f238450385a02367db7/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.872301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77ab7-306b-4a60-9169-de37eaea9cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.873513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77ab7-306b-4a60-9169-de37eaea9cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.873972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77ab7-306b-4a60-9169-de37eaea9cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.874407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77ab7-306b-4a60-9169-de37eaea9cf0 admin admin] PATH_INFO: `/v3/projects/804d63e1308b4729aff976d65f667e28/users/e4681e0753e84aea8d453465a424e2e3/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.893599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905ebce-a719-4b1f-b38c-a06000539ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=233a5a65caee4bc3be172bbd02c4efff, user_id=4160745043014f238450385a02367db7, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.896295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905ebce-a719-4b1f-b38c-a06000539ce1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.897591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77ab7-306b-4a60-9169-de37eaea9cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=804d63e1308b4729aff976d65f667e28, user_id=e4681e0753e84aea8d453465a424e2e3, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:46.900561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77ab7-306b-4a60-9169-de37eaea9cf0 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:46.913186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 814/1600] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:46 2022] PUT /identity/v3/projects/233a5a65caee4bc3be172bbd02c4efff/users/4160745043014f238450385a02367db7/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:46.914008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ebce-a719-4b1f-b38c-a06000539ce1 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.918389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 787/1601] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:46 2022] PUT /identity/v3/projects/804d63e1308b4729aff976d65f667e28/users/e4681e0753e84aea8d453465a424e2e3/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:46.920211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77ab7-306b-4a60-9169-de37eaea9cf0 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:46.934127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:46.985708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ebce-a719-4b1f-b38c-a06000539ce1 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:46.990723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36aa8e-dd29-4867-900f-ac2e6c2a25f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:46.991392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36aa8e-dd29-4867-900f-ac2e6c2a25f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:46.991665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36aa8e-dd29-4867-900f-ac2e6c2a25f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:46.991933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36aa8e-dd29-4867-900f-ac2e6c2a25f5 admin admin] PATH_INFO: `/v3/projects/ea483f6ff12d425fa1e8aa29e472dfe2/users/74d0de83f0e54dc8a3c85f2cbda50349/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:46.994756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77ab7-306b-4a60-9169-de37eaea9cf0 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:47.000944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d5056-1111-4839-bc2b-58f91ad91d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:47.001672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d5056-1111-4839-bc2b-58f91ad91d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.001952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d5056-1111-4839-bc2b-58f91ad91d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.002227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d5056-1111-4839-bc2b-58f91ad91d07 admin admin] PATH_INFO: `/v3/projects/cd4a7602dab34627b2847a572e39816b/users/fe4d1bebc3e74972b86cffac4388f493/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.009199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36aa8e-dd29-4867-900f-ac2e6c2a25f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea483f6ff12d425fa1e8aa29e472dfe2, user_id=74d0de83f0e54dc8a3c85f2cbda50349, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:47.012344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36aa8e-dd29-4867-900f-ac2e6c2a25f5 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:47.018856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d5056-1111-4839-bc2b-58f91ad91d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4a7602dab34627b2847a572e39816b, user_id=fe4d1bebc3e74972b86cffac4388f493, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:47.022269 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d5056-1111-4839-bc2b-58f91ad91d07 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:47.031312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 815/1602] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:46 2022] PUT /identity/v3/projects/ea483f6ff12d425fa1e8aa29e472dfe2/users/74d0de83f0e54dc8a3c85f2cbda50349/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:47.036032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36aa8e-dd29-4867-900f-ac2e6c2a25f5 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:47.039767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 788/1603] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:46 2022] PUT /identity/v3/projects/cd4a7602dab34627b2847a572e39816b/users/fe4d1bebc3e74972b86cffac4388f493/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:47.041000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c7f5-f5b8-4f17-9917-686cad7b19b0 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.041278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c7f5-f5b8-4f17-9917-686cad7b19b0 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.041543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c7f5-f5b8-4f17-9917-686cad7b19b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.042132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:47.071743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-fc15c7f5-f5b8-4f17-9917-686cad7b19b0 None None] MFA Rules not processed for user `098075c218cb4e6dbfd873e9443a38c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:47.078173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-fc15c7f5-f5b8-4f17-9917-686cad7b19b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:47.110599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36aa8e-dd29-4867-900f-ac2e6c2a25f5 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:47.158449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 789/1604] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:47.158449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13799b-445b-4c66-b2fa-77ab4dd51bcc None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.158449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13799b-445b-4c66-b2fa-77ab4dd51bcc None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.158449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13799b-445b-4c66-b2fa-77ab4dd51bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.181034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-9f13799b-445b-4c66-b2fa-77ab4dd51bcc None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:47.182552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9f13799b-445b-4c66-b2fa-77ab4dd51bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:47.186242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd22248-acba-411d-a645-35f4cb87ce01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:47.187304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd22248-acba-411d-a645-35f4cb87ce01 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.187859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd22248-acba-411d-a645-35f4cb87ce01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.188141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd22248-acba-411d-a645-35f4cb87ce01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.189032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd22248-acba-411d-a645-35f4cb87ce01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:47.191342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd22248-acba-411d-a645-35f4cb87ce01 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:47.195131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 790/1605] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:47.196807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95c56-e637-4743-bc07-330dcae87606 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.197229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95c56-e637-4743-bc07-330dcae87606 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.197591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95c56-e637-4743-bc07-330dcae87606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.205527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 816/1606] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:47.207061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f0ed-c6a5-4b5a-97f0-c4e9be8dfeea None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.207245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f0ed-c6a5-4b5a-97f0-c4e9be8dfeea None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.207525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f0ed-c6a5-4b5a-97f0-c4e9be8dfeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.220306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-85b95c56-e637-4743-bc07-330dcae87606 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:47.221763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-85b95c56-e637-4743-bc07-330dcae87606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:47.232970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 791/1607] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:47.233652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-48c0f0ed-c6a5-4b5a-97f0-c4e9be8dfeea None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:47.236115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1215b8-1b63-4dfd-9734-a39507126c11 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.237327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-48c0f0ed-c6a5-4b5a-97f0-c4e9be8dfeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:47.238866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1215b8-1b63-4dfd-9734-a39507126c11 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.240128 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1215b8-1b63-4dfd-9734-a39507126c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.255036 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 817/1608] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:47.256996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a611d-4e88-4bc4-a378-c368927e938f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.257647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a611d-4e88-4bc4-a378-c368927e938f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.258402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a611d-4e88-4bc4-a378-c368927e938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.270005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6c1215b8-1b63-4dfd-9734-a39507126c11 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:47.271886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6c1215b8-1b63-4dfd-9734-a39507126c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:47.286290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 792/1609] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:47.286972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1215b8-1b63-4dfd-9734-a39507126c11 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:47.295451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-325a611d-4e88-4bc4-a378-c368927e938f None None] MFA Rules not processed for user `fe4d1bebc3e74972b86cffac4388f493`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:47.297602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-325a611d-4e88-4bc4-a378-c368927e938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:47.360070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1215b8-1b63-4dfd-9734-a39507126c11 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:47.365385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b3b39-0294-4382-a169-67a51346d388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:47.365385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3b39-0294-4382-a169-67a51346d388 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.365909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3b39-0294-4382-a169-67a51346d388 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.366341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3b39-0294-4382-a169-67a51346d388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.377953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b3b39-0294-4382-a169-67a51346d388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:47.379691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b3b39-0294-4382-a169-67a51346d388 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:47.390163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 793/1610] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:47.393936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 818/1611] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:47.395161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a611d-4e88-4bc4-a378-c368927e938f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:47.419668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b3b39-0294-4382-a169-67a51346d388 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:47.433325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:47.446276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b3b39-0294-4382-a169-67a51346d388 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:47.462595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8a28-c744-48f9-9c00-ad947aa84c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:47.463464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8a28-c744-48f9-9c00-ad947aa84c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.463902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8a28-c744-48f9-9c00-ad947aa84c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.464509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8a28-c744-48f9-9c00-ad947aa84c6c admin admin] PATH_INFO: `/v3/projects/6f05ccd2435a40feb1a8e2296485a7ba/users/51cfb0377e6c49b6afcf9f057b44706b/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.468237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:47.492700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a611d-4e88-4bc4-a378-c368927e938f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:47.504695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2a1f0-f8a8-4087-9013-d75f91ba17b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:47.506549 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b8a28-c744-48f9-9c00-ad947aa84c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f05ccd2435a40feb1a8e2296485a7ba, user_id=51cfb0377e6c49b6afcf9f057b44706b, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:47.508303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a1f0-f8a8-4087-9013-d75f91ba17b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.508743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a1f0-f8a8-4087-9013-d75f91ba17b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.509199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a1f0-f8a8-4087-9013-d75f91ba17b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.514051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b8a28-c744-48f9-9c00-ad947aa84c6c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:47.534710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a1f0-f8a8-4087-9013-d75f91ba17b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:47.539461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a1f0-f8a8-4087-9013-d75f91ba17b5 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:47.541600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 794/1612] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:47 2022] PUT /identity/v3/projects/6f05ccd2435a40feb1a8e2296485a7ba/users/51cfb0377e6c49b6afcf9f057b44706b/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:47.542922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8a28-c744-48f9-9c00-ad947aa84c6c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:47.590791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 819/1613] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:47.596758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2a1f0-f8a8-4087-9013-d75f91ba17b5 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:47.614086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2a1f0-f8a8-4087-9013-d75f91ba17b5 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:47.648059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8a28-c744-48f9-9c00-ad947aa84c6c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:47.656217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814c5e1-73fb-4942-ac3b-bc7f2e57bd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:47.656934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814c5e1-73fb-4942-ac3b-bc7f2e57bd59 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.657213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814c5e1-73fb-4942-ac3b-bc7f2e57bd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.657486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814c5e1-73fb-4942-ac3b-bc7f2e57bd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.757990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64602951-ceb7-4187-939d-4148da1d2c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:47.758643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602951-ceb7-4187-939d-4148da1d2c1b service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.758924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602951-ceb7-4187-939d-4148da1d2c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.759198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602951-ceb7-4187-939d-4148da1d2c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.760267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814c5e1-73fb-4942-ac3b-bc7f2e57bd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:47.766240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814c5e1-73fb-4942-ac3b-bc7f2e57bd59 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:47.784681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64602951-ceb7-4187-939d-4148da1d2c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:47.786186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64602951-ceb7-4187-939d-4148da1d2c1b service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:47.798988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 820/1614] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:47.799214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 795/1615] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:47.801237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64602951-ceb7-4187-939d-4148da1d2c1b service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:47.808354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737d191-f1f7-45ac-b8f9-f31c3b9ab193 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.808675 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737d191-f1f7-45ac-b8f9-f31c3b9ab193 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.809016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737d191-f1f7-45ac-b8f9-f31c3b9ab193 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.812702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64602951-ceb7-4187-939d-4148da1d2c1b service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:47.817953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 796/1616] 10.222.0.49 () {54 vars in 965 bytes} [Fri Sep 16 19:26:47 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:26:47.819513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560d3c6-d088-4585-a3e1-e095959d827a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:47.821276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94eab6-4606-4adc-b32b-5dccfa424c14 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.822304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560d3c6-d088-4585-a3e1-e095959d827a service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.822807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560d3c6-d088-4585-a3e1-e095959d827a service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.823596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560d3c6-d088-4585-a3e1-e095959d827a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.826859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94eab6-4606-4adc-b32b-5dccfa424c14 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.827241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94eab6-4606-4adc-b32b-5dccfa424c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.848657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560d3c6-d088-4585-a3e1-e095959d827a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:47.856246 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560d3c6-d088-4585-a3e1-e095959d827a service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:47.891585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 821/1617] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:47.894364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c979f48-8087-429a-ae4b-b4212facf21c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:47.896196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c979f48-8087-429a-ae4b-b4212facf21c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:47.896461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c979f48-8087-429a-ae4b-b4212facf21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:47.926502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-0c94eab6-4606-4adc-b32b-5dccfa424c14 None None] MFA Rules not processed for user `51cfb0377e6c49b6afcf9f057b44706b`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:47.934437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0c94eab6-4606-4adc-b32b-5dccfa424c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:48.002147 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6c979f48-8087-429a-ae4b-b4212facf21c None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:48.003914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6c979f48-8087-429a-ae4b-b4212facf21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:48.099564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 797/1618] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:48.173040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a29e5b-12c2-4356-80c9-a4446a64a765 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:48.173467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a29e5b-12c2-4356-80c9-a4446a64a765 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:48.173768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a29e5b-12c2-4356-80c9-a4446a64a765 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:48.180261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 822/1619] 10.222.0.49 () {58 vars in 1062 bytes} [Fri Sep 16 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:48.190388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c979f48-8087-429a-ae4b-b4212facf21c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:48.191664 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 798/1620] 10.222.0.49 () {54 vars in 965 bytes} [Fri Sep 16 19:26:48 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:26:48.203286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5b0c1-84b5-46f2-8196-ad607211b285 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:48.203860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5b0c1-84b5-46f2-8196-ad607211b285 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:48.204482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5b0c1-84b5-46f2-8196-ad607211b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:48.231217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c979f48-8087-429a-ae4b-b4212facf21c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:48.252033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaa1da-58ea-4b24-a75e-baa3205cf2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:48.252716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa1da-58ea-4b24-a75e-baa3205cf2d7 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:48.252981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa1da-58ea-4b24-a75e-baa3205cf2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:48.253254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa1da-58ea-4b24-a75e-baa3205cf2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:48.255262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e9e5b0c1-84b5-46f2-8196-ad607211b285 None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:48.256656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e9e5b0c1-84b5-46f2-8196-ad607211b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:48.289046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 799/1621] 10.222.0.49 () {58 vars in 1062 bytes} [Fri Sep 16 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:26:48.298558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5b0c1-84b5-46f2-8196-ad607211b285 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:48.319692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5b0c1-84b5-46f2-8196-ad607211b285 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:48.330435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecab9f-5432-4088-a368-f54b8f7ac977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:48.361376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecab9f-5432-4088-a368-f54b8f7ac977 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:48.361376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecab9f-5432-4088-a368-f54b8f7ac977 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:48.361376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecab9f-5432-4088-a368-f54b8f7ac977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:48.389479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecab9f-5432-4088-a368-f54b8f7ac977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:48.390833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecab9f-5432-4088-a368-f54b8f7ac977 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:48.399351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:48.444325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 800/1622] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:48.451685 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaa1da-58ea-4b24-a75e-baa3205cf2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:48.453581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaa1da-58ea-4b24-a75e-baa3205cf2d7 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:48.472985 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 823/1623] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:48.933814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818f3e1-dd64-4063-a22b-949ed0f28411 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:48.934379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818f3e1-dd64-4063-a22b-949ed0f28411 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:48.935111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818f3e1-dd64-4063-a22b-949ed0f28411 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:48.936650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 801/1624] 10.222.0.49 () {54 vars in 912 bytes} [Fri Sep 16 19:26:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:26:48.942644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb844-6249-4a8a-90ac-de76cdea07fd None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:48.942934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb844-6249-4a8a-90ac-de76cdea07fd None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:48.943522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb844-6249-4a8a-90ac-de76cdea07fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:48.965241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ed8cb844-6249-4a8a-90ac-de76cdea07fd None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:48.966759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ed8cb844-6249-4a8a-90ac-de76cdea07fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:48.973005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0239bb-08e8-4701-a574-4b9e349fb832 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:48.973417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0239bb-08e8-4701-a574-4b9e349fb832 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:48.973698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0239bb-08e8-4701-a574-4b9e349fb832 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:48.975546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 802/1625] 10.222.0.49 () {54 vars in 912 bytes} [Fri Sep 16 19:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:26:48.983893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 824/1626] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:26:48.997200 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0239bb-08e8-4701-a574-4b9e349fb832 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:49.001422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefb10-4877-4c37-b15d-46e929d29019 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:49.001744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefb10-4877-4c37-b15d-46e929d29019 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:49.002024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefb10-4877-4c37-b15d-46e929d29019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:49.003055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:49.040477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f3eefb10-4877-4c37-b15d-46e929d29019 None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:49.042027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f3eefb10-4877-4c37-b15d-46e929d29019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:49.057872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 825/1627] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:26:49.078322 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eefb10-4877-4c37-b15d-46e929d29019 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:49.160841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eefb10-4877-4c37-b15d-46e929d29019 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:49.169345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1012f3-d406-4189-97d9-3d6d07ccf1c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:49.170539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1012f3-d406-4189-97d9-3d6d07ccf1c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:49.171315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1012f3-d406-4189-97d9-3d6d07ccf1c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:49.171741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1012f3-d406-4189-97d9-3d6d07ccf1c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:49.180807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0239bb-08e8-4701-a574-4b9e349fb832 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:49.192012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b92fde-1aef-400c-91db-01e0ea9d2440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:49.192172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1012f3-d406-4189-97d9-3d6d07ccf1c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:49.192673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92fde-1aef-400c-91db-01e0ea9d2440 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:49.192951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92fde-1aef-400c-91db-01e0ea9d2440 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:49.193218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92fde-1aef-400c-91db-01e0ea9d2440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:49.194930 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1012f3-d406-4189-97d9-3d6d07ccf1c9 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:49.221164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b92fde-1aef-400c-91db-01e0ea9d2440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:49.225986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b92fde-1aef-400c-91db-01e0ea9d2440 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:49.239697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 826/1628] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:49.258099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 803/1629] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:49.483101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1012f3-d406-4189-97d9-3d6d07ccf1c9 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:49.503526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1012f3-d406-4189-97d9-3d6d07ccf1c9 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:49.515588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:49.516250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:49.516636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:49.517249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] PATH_INFO: `/v3/users/51cfb0377e6c49b6afcf9f057b44706b` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:49.518406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cfb0377e6c49b6afcf9f057b44706b)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:49.527698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:49.660185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cfb0377e6c49b6afcf9f057b44706b'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:49.660948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cfb0377e6c49b6afcf9f057b44706b'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:49.661901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cfb0377e6c49b6afcf9f057b44706b'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:49.678598 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cfb0377e6c49b6afcf9f057b44706b'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:49.711061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cfb0377e6c49b6afcf9f057b44706b'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:49.744627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 827/1630] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:26:49 2022] DELETE /identity/v3/users/51cfb0377e6c49b6afcf9f057b44706b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:49.746685 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea98e-0d65-4850-8651-e477c73acb4c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:49.746989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea98e-0d65-4850-8651-e477c73acb4c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:49.747240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea98e-0d65-4850-8651-e477c73acb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:49.780049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ff1ea98e-0d65-4850-8651-e477c73acb4c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:49.781682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ff1ea98e-0d65-4850-8651-e477c73acb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:49.921754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 804/1631] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:49.938088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:49.941920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:50.041223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:50.092076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac0a8d-fd36-406d-8f2f-00e19710c08c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:50.104080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a20d-dfc6-4bdb-9551-d46c46192568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:50.104729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a20d-dfc6-4bdb-9551-d46c46192568 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:50.105127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a20d-dfc6-4bdb-9551-d46c46192568 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:50.105407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a20d-dfc6-4bdb-9551-d46c46192568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:50.145000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69a20d-dfc6-4bdb-9551-d46c46192568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:50.146493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69a20d-dfc6-4bdb-9551-d46c46192568 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:50.188830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 828/1632] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:50.825752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6758a-7832-4b3f-862c-cf705714adfa None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:50.826672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6758a-7832-4b3f-862c-cf705714adfa None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:50.827137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6758a-7832-4b3f-862c-cf705714adfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:50.881528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-21d6758a-7832-4b3f-862c-cf705714adfa None None] MFA Rules not processed for user `e10a141a166449b78f1959e9331e6d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:50.883880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-21d6758a-7832-4b3f-862c-cf705714adfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:50.987690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 805/1633] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:50.995068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a20d-dfc6-4bdb-9551-d46c46192568 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:50.996953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cc69a20d-dfc6-4bdb-9551-d46c46192568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:51.025756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a20d-dfc6-4bdb-9551-d46c46192568 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:51.038517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94725bd-681b-4f46-b2b8-3b5fe3bd81a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:51.039537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94725bd-681b-4f46-b2b8-3b5fe3bd81a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:51.039944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94725bd-681b-4f46-b2b8-3b5fe3bd81a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:51.040280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94725bd-681b-4f46-b2b8-3b5fe3bd81a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:51.041840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94725bd-681b-4f46-b2b8-3b5fe3bd81a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:51.048198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94725bd-681b-4f46-b2b8-3b5fe3bd81a8 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:51.108030 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 829/1634] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:50 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:51.108306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6758a-7832-4b3f-862c-cf705714adfa None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:51.124325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6758a-7832-4b3f-862c-cf705714adfa None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:51.205175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:51.212149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94725bd-681b-4f46-b2b8-3b5fe3bd81a8 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:51.215686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d94725bd-681b-4f46-b2b8-3b5fe3bd81a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:51.267514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b3885-a27c-4e77-821f-c31231d8c5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:51.268308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b3885-a27c-4e77-821f-c31231d8c5ff admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:51.268698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b3885-a27c-4e77-821f-c31231d8c5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:51.269794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b3885-a27c-4e77-821f-c31231d8c5ff admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:51.270533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b3885-a27c-4e77-821f-c31231d8c5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:51.273309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b3885-a27c-4e77-821f-c31231d8c5ff admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:51.361658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 806/1635] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:51 2022] POST /identity/v3/users => generated 308 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:51.369223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b3885-a27c-4e77-821f-c31231d8c5ff admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:51.393791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b3885-a27c-4e77-821f-c31231d8c5ff admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:51.408092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb271b1-9814-446b-bec2-5e890a341da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:51.408901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb271b1-9814-446b-bec2-5e890a341da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:51.409188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb271b1-9814-446b-bec2-5e890a341da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:51.409462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb271b1-9814-446b-bec2-5e890a341da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:51.410820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb271b1-9814-446b-bec2-5e890a341da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:51.413690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb271b1-9814-446b-bec2-5e890a341da1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:51.440172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 807/1636] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:51.444361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb271b1-9814-446b-bec2-5e890a341da1 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:51.457900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94725bd-681b-4f46-b2b8-3b5fe3bd81a8 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:51.467921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:51.468661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:51.469395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:51.469395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] PATH_INFO: `/v3/projects/6f05ccd2435a40feb1a8e2296485a7ba` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:51.478494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f05ccd2435a40feb1a8e2296485a7ba)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:51.479625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: WARNING py.warnings [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:26:51.479625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: warnings.warn(msg) Sep 16 19:26:51.479625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: Sep 16 19:26:51.480965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:51.489260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb271b1-9814-446b-bec2-5e890a341da1 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:51.496474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39756d1-d471-4d45-9f27-9dfa23226cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:51.498019 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39756d1-d471-4d45-9f27-9dfa23226cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:51.498413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39756d1-d471-4d45-9f27-9dfa23226cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:51.498737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39756d1-d471-4d45-9f27-9dfa23226cf9 admin admin] PATH_INFO: `/v3/projects/2bb26df5a5a741f8a84f4b43aa052c91/users/9595ffbc5b7644f9b3d3d37ddacf3488/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:51.526194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39756d1-d471-4d45-9f27-9dfa23226cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb26df5a5a741f8a84f4b43aa052c91, user_id=9595ffbc5b7644f9b3d3d37ddacf3488, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:51.530442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39756d1-d471-4d45-9f27-9dfa23226cf9 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:51.559575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 808/1637] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:51 2022] PUT /identity/v3/projects/2bb26df5a5a741f8a84f4b43aa052c91/users/9595ffbc5b7644f9b3d3d37ddacf3488/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:26:51.564319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39756d1-d471-4d45-9f27-9dfa23226cf9 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:51.633504 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f05ccd2435a40feb1a8e2296485a7ba', 'request_id': 'req-57ceb03a-3b60-4d24-b17b-8d728417b0db'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:51.691085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f05ccd2435a40feb1a8e2296485a7ba', 'request_id': 'req-57ceb03a-3b60-4d24-b17b-8d728417b0db'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:51.723989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f05ccd2435a40feb1a8e2296485a7ba', 'request_id': 'req-57ceb03a-3b60-4d24-b17b-8d728417b0db'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:51.745505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39756d1-d471-4d45-9f27-9dfa23226cf9 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:51.772062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] The token cache is being invalidate because project 6f05ccd2435a40feb1a8e2296485a7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:26:51.772361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:51.773631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-57ceb03a-3b60-4d24-b17b-8d728417b0db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:51.780255 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 830/1638] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:26:51 2022] DELETE /identity/v3/projects/6f05ccd2435a40feb1a8e2296485a7ba => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:51.783397 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659bec8-2a66-4b66-a12b-d311df3744b4 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:51.783681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659bec8-2a66-4b66-a12b-d311df3744b4 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:51.783953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659bec8-2a66-4b66-a12b-d311df3744b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:51.834064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-e659bec8-2a66-4b66-a12b-d311df3744b4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:51.841858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e659bec8-2a66-4b66-a12b-d311df3744b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:51.935793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f894c68-3a9b-4b1e-9995-6f484cf95db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:51.937156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f894c68-3a9b-4b1e-9995-6f484cf95db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:51.937582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f894c68-3a9b-4b1e-9995-6f484cf95db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:51.937991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f894c68-3a9b-4b1e-9995-6f484cf95db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:51.938793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f894c68-3a9b-4b1e-9995-6f484cf95db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:51.940620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f894c68-3a9b-4b1e-9995-6f484cf95db9 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:51.963743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:51.976064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 809/1639] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:51.983854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f894c68-3a9b-4b1e-9995-6f484cf95db9 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:52.000111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 831/1640] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:26:52.001105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4f894c68-3a9b-4b1e-9995-6f484cf95db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:52.007738 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b34ba-08e7-40eb-8fcb-07efd7444f2e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:52.008022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b34ba-08e7-40eb-8fcb-07efd7444f2e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:52.008295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b34ba-08e7-40eb-8fcb-07efd7444f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:52.030304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ce7b34ba-08e7-40eb-8fcb-07efd7444f2e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:52.031580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ce7b34ba-08e7-40eb-8fcb-07efd7444f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:52.032291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f894c68-3a9b-4b1e-9995-6f484cf95db9 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:52.044695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 832/1641] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:26:52.045806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b34ba-08e7-40eb-8fcb-07efd7444f2e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:52.053173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2dee0-7b6b-4ee0-8654-32dda283a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:52.054028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2dee0-7b6b-4ee0-8654-32dda283a9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:52.054317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2dee0-7b6b-4ee0-8654-32dda283a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:52.054593 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2dee0-7b6b-4ee0-8654-32dda283a9d6 admin admin] PATH_INFO: `/v3/projects/2bb26df5a5a741f8a84f4b43aa052c91/users/9595ffbc5b7644f9b3d3d37ddacf3488/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:52.055884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b34ba-08e7-40eb-8fcb-07efd7444f2e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:52.061020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df663f8c-d5a8-42f9-8abe-6bc4d08c7939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:52.061652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df663f8c-d5a8-42f9-8abe-6bc4d08c7939 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:52.061906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2dee0-7b6b-4ee0-8654-32dda283a9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb26df5a5a741f8a84f4b43aa052c91, user_id=9595ffbc5b7644f9b3d3d37ddacf3488, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:52.062007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df663f8c-d5a8-42f9-8abe-6bc4d08c7939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:52.062178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df663f8c-d5a8-42f9-8abe-6bc4d08c7939 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:52.062837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df663f8c-d5a8-42f9-8abe-6bc4d08c7939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:26:52.063136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df663f8c-d5a8-42f9-8abe-6bc4d08c7939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:52.064842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df663f8c-d5a8-42f9-8abe-6bc4d08c7939 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:52.064949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2dee0-7b6b-4ee0-8654-32dda283a9d6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:52.083069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 833/1642] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:26:52.084203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df663f8c-d5a8-42f9-8abe-6bc4d08c7939 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:52.095550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df663f8c-d5a8-42f9-8abe-6bc4d08c7939 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:52.107240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 810/1643] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:51 2022] PUT /identity/v3/projects/2bb26df5a5a741f8a84f4b43aa052c91/users/9595ffbc5b7644f9b3d3d37ddacf3488/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:52.250923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4e1a-8cf7-49d8-9f8c-4cb09d746a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:52.251779 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4e1a-8cf7-49d8-9f8c-4cb09d746a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:52.252684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4e1a-8cf7-49d8-9f8c-4cb09d746a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:52.254356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4e1a-8cf7-49d8-9f8c-4cb09d746a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:52.255493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a4e1a-8cf7-49d8-9f8c-4cb09d746a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:52.260131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a4e1a-8cf7-49d8-9f8c-4cb09d746a91 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:52.344293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 834/1644] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:52 2022] POST /identity/v3/projects => generated 403 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:52.349196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2dee0-7b6b-4ee0-8654-32dda283a9d6 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:52.368560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2dee0-7b6b-4ee0-8654-32dda283a9d6 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:52.406945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:52.495401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90784aeb-b5fc-4a6f-b61a-bb0671c1a592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:52.496046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784aeb-b5fc-4a6f-b61a-bb0671c1a592 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:52.496457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784aeb-b5fc-4a6f-b61a-bb0671c1a592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:52.496741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784aeb-b5fc-4a6f-b61a-bb0671c1a592 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:52.497454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90784aeb-b5fc-4a6f-b61a-bb0671c1a592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:52.499518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90784aeb-b5fc-4a6f-b61a-bb0671c1a592 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:52.553458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 811/1645] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:52 2022] POST /identity/v3/users => generated 302 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:26:52.558042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4e1a-8cf7-49d8-9f8c-4cb09d746a91 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:52.615278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4e1a-8cf7-49d8-9f8c-4cb09d746a91 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:52.648104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe142c-98ca-45b6-87f8-e880da5b3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:52.649790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe142c-98ca-45b6-87f8-e880da5b3154 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:52.650074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe142c-98ca-45b6-87f8-e880da5b3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:52.651097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe142c-98ca-45b6-87f8-e880da5b3154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:52.651777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe142c-98ca-45b6-87f8-e880da5b3154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:52.659502 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe142c-98ca-45b6-87f8-e880da5b3154 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:52.689923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90784aeb-b5fc-4a6f-b61a-bb0671c1a592 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:52.690989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 835/1646] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:52.708060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90784aeb-b5fc-4a6f-b61a-bb0671c1a592 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:52.725224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d725f3-9d1f-4166-ab84-5013afc1a1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:52.726308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d725f3-9d1f-4166-ab84-5013afc1a1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:52.726782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d725f3-9d1f-4166-ab84-5013afc1a1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:52.727272 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d725f3-9d1f-4166-ab84-5013afc1a1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:52.728150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d725f3-9d1f-4166-ab84-5013afc1a1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:52.730095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d725f3-9d1f-4166-ab84-5013afc1a1b5 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:52.754617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 812/1647] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:26:52.762476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe142c-98ca-45b6-87f8-e880da5b3154 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:52.776330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe142c-98ca-45b6-87f8-e880da5b3154 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:52.793374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f60244-c410-4caf-9694-915211aa0708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:52.799404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60244-c410-4caf-9694-915211aa0708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:52.800492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60244-c410-4caf-9694-915211aa0708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:52.801197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60244-c410-4caf-9694-915211aa0708 admin admin] PATH_INFO: `/v3/projects/b4b64a6a42f64b97827f79fff23015be/users/b5a39295f0894344bc99cc4824bfa698/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:52.866496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f60244-c410-4caf-9694-915211aa0708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b64a6a42f64b97827f79fff23015be, user_id=b5a39295f0894344bc99cc4824bfa698, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:52.869278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f60244-c410-4caf-9694-915211aa0708 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:52.900447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 836/1648] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:52 2022] PUT /identity/v3/projects/b4b64a6a42f64b97827f79fff23015be/users/b5a39295f0894344bc99cc4824bfa698/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:52.914396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c5ac4-22b9-4f91-bd9a-d5166062f1bb None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:52.914817 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c5ac4-22b9-4f91-bd9a-d5166062f1bb None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:52.915214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c5ac4-22b9-4f91-bd9a-d5166062f1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:52.968660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-140c5ac4-22b9-4f91-bd9a-d5166062f1bb None None] MFA Rules not processed for user `b5a39295f0894344bc99cc4824bfa698`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:52.970623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-140c5ac4-22b9-4f91-bd9a-d5166062f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:53.064419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 813/1649] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:26:53.069368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f60244-c410-4caf-9694-915211aa0708 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:53.155697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f60244-c410-4caf-9694-915211aa0708 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:53.161778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa097d-5949-48be-82ab-070943ed10e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:53.162934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa097d-5949-48be-82ab-070943ed10e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:53.163419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa097d-5949-48be-82ab-070943ed10e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:53.163884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa097d-5949-48be-82ab-070943ed10e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:53.165074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa097d-5949-48be-82ab-070943ed10e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:53.167518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa097d-5949-48be-82ab-070943ed10e3 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:53.217927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c5ac4-22b9-4f91-bd9a-d5166062f1bb None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:53.229472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 837/1650] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:26:53 2022] POST /identity/v3/projects => generated 403 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:53.233678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c5ac4-22b9-4f91-bd9a-d5166062f1bb None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:53.335190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91fb40-4a66-4a43-ae29-f46a034e79f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:53.335705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91fb40-4a66-4a43-ae29-f46a034e79f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:53.336105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91fb40-4a66-4a43-ae29-f46a034e79f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:53.336515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91fb40-4a66-4a43-ae29-f46a034e79f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:53.337314 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91fb40-4a66-4a43-ae29-f46a034e79f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:53.339886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91fb40-4a66-4a43-ae29-f46a034e79f1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:53.380195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa097d-5949-48be-82ab-070943ed10e3 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:53.391043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 814/1651] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:26:53 2022] POST /identity/v3/users => generated 308 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:26:53.393644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa097d-5949-48be-82ab-070943ed10e3 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:53.399454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc200e-519c-4e7b-98c8-401ecd762e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:53.400409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc200e-519c-4e7b-98c8-401ecd762e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:53.400922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc200e-519c-4e7b-98c8-401ecd762e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:53.413443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc200e-519c-4e7b-98c8-401ecd762e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:53.416290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc200e-519c-4e7b-98c8-401ecd762e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:53.418836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc200e-519c-4e7b-98c8-401ecd762e42 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:53.422353 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:53.439491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 838/1652] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:26:53.444167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91fb40-4a66-4a43-ae29-f46a034e79f1 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:53.462556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91fb40-4a66-4a43-ae29-f46a034e79f1 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:53.472672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78834ff-aa6c-4fd1-b1ee-f2352734ce32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:53.474533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78834ff-aa6c-4fd1-b1ee-f2352734ce32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:53.474533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78834ff-aa6c-4fd1-b1ee-f2352734ce32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:53.474533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78834ff-aa6c-4fd1-b1ee-f2352734ce32 admin admin] PATH_INFO: `/v3/projects/d5da3952a897409380d15e1d52d31923/users/e8b3b06d9bc744a59a4b0c7a90f245d3/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:53.510403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78834ff-aa6c-4fd1-b1ee-f2352734ce32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5da3952a897409380d15e1d52d31923, user_id=e8b3b06d9bc744a59a4b0c7a90f245d3, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:53.513951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78834ff-aa6c-4fd1-b1ee-f2352734ce32 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:53.517857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:53.546596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 815/1653] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:53 2022] PUT /identity/v3/projects/d5da3952a897409380d15e1d52d31923/users/e8b3b06d9bc744a59a4b0c7a90f245d3/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:53.549872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc200e-519c-4e7b-98c8-401ecd762e42 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:53.562593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc200e-519c-4e7b-98c8-401ecd762e42 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:53.672112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157f131-327c-43af-9d2a-e15e1a23ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:53.673750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f131-327c-43af-9d2a-e15e1a23ae1a admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:53.674125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f131-327c-43af-9d2a-e15e1a23ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:53.674408 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f131-327c-43af-9d2a-e15e1a23ae1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:53.675564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157f131-327c-43af-9d2a-e15e1a23ae1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:53.677791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157f131-327c-43af-9d2a-e15e1a23ae1a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:53.707900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 839/1654] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:26:53.715643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78834ff-aa6c-4fd1-b1ee-f2352734ce32 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:53.732547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78834ff-aa6c-4fd1-b1ee-f2352734ce32 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:53.740715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b45cd1-be1e-4eea-8dcb-25ac79448663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:53.741531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b45cd1-be1e-4eea-8dcb-25ac79448663 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:53.741981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b45cd1-be1e-4eea-8dcb-25ac79448663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:53.745202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b45cd1-be1e-4eea-8dcb-25ac79448663 admin admin] PATH_INFO: `/v3/projects/d5da3952a897409380d15e1d52d31923/users/e8b3b06d9bc744a59a4b0c7a90f245d3/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:53.749557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b45cd1-be1e-4eea-8dcb-25ac79448663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5da3952a897409380d15e1d52d31923, user_id=e8b3b06d9bc744a59a4b0c7a90f245d3, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:53.756178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b45cd1-be1e-4eea-8dcb-25ac79448663 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:53.803802 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb34d-3073-4a24-bd11-3c88dcbb718a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:53.804839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb34d-3073-4a24-bd11-3c88dcbb718a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:53.805127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb34d-3073-4a24-bd11-3c88dcbb718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:53.813795 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 816/1655] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:26:53 2022] PUT /identity/v3/projects/d5da3952a897409380d15e1d52d31923/users/e8b3b06d9bc744a59a4b0c7a90f245d3/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:53.879718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5cceb34d-3073-4a24-bd11-3c88dcbb718a None None] MFA Rules not processed for user `e8b3b06d9bc744a59a4b0c7a90f245d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:53.881179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5cceb34d-3073-4a24-bd11-3c88dcbb718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:54.072376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 840/1656] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:54.087313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b45cd1-be1e-4eea-8dcb-25ac79448663 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:54.090000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b4b45cd1-be1e-4eea-8dcb-25ac79448663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:54.219432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b45cd1-be1e-4eea-8dcb-25ac79448663 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:54.224473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285a265-1b55-4048-84eb-95b775f9fa54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:54.225362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285a265-1b55-4048-84eb-95b775f9fa54 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:54.225733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285a265-1b55-4048-84eb-95b775f9fa54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:54.226097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285a265-1b55-4048-84eb-95b775f9fa54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:54.240431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285a265-1b55-4048-84eb-95b775f9fa54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:54.242817 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285a265-1b55-4048-84eb-95b775f9fa54 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:54.269247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 817/1657] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:54 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:26:54.708611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dbc59-2693-4f98-a863-c42f7a1717bd None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:54.708900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dbc59-2693-4f98-a863-c42f7a1717bd None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:54.709182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dbc59-2693-4f98-a863-c42f7a1717bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:54.780897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6d7dbc59-2693-4f98-a863-c42f7a1717bd None None] MFA Rules not processed for user `9595ffbc5b7644f9b3d3d37ddacf3488`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:54.782222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6d7dbc59-2693-4f98-a863-c42f7a1717bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:54.959337 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 841/1658] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:54 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:56.862381 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8151055-dfa8-4fb1-914a-fe7e7ffb3c2c None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:56.862890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8151055-dfa8-4fb1-914a-fe7e7ffb3c2c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:56.862974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8151055-dfa8-4fb1-914a-fe7e7ffb3c2c None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:56.864722 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 818/1659] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:26:56.885682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fb663-8a5b-4dca-bead-9c2662cf1ab7 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:56.887235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fb663-8a5b-4dca-bead-9c2662cf1ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:56.888525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fb663-8a5b-4dca-bead-9c2662cf1ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:56.904492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:56.941217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-522fb663-8a5b-4dca-bead-9c2662cf1ab7 None None] MFA Rules not processed for user `d09ca68fdd5b4e178bcd6a5c8bccc4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:56.944008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-522fb663-8a5b-4dca-bead-9c2662cf1ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:57.113972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 842/1660] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:26:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:57.134023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8151055-dfa8-4fb1-914a-fe7e7ffb3c2c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:57.135791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d8151055-dfa8-4fb1-914a-fe7e7ffb3c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:57.182363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8151055-dfa8-4fb1-914a-fe7e7ffb3c2c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:57.225785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e47dd-afd9-4165-9804-6189b5d84fd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:57.226746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e47dd-afd9-4165-9804-6189b5d84fd5 service placement] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:57.227249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e47dd-afd9-4165-9804-6189b5d84fd5 service placement] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:57.227718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e47dd-afd9-4165-9804-6189b5d84fd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:57.245476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e47dd-afd9-4165-9804-6189b5d84fd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:57.247974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e47dd-afd9-4165-9804-6189b5d84fd5 service placement] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:57.262872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 819/1661] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:58.312184 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fb663-8a5b-4dca-bead-9c2662cf1ab7 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:58.416823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ec19c-a98a-4bd8-bd7a-021754632d16 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:58.422137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ec19c-a98a-4bd8-bd7a-021754632d16 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:58.422137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ec19c-a98a-4bd8-bd7a-021754632d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:58.495121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-719ec19c-a98a-4bd8-bd7a-021754632d16 None None] MFA Rules not processed for user `92f0c702f8ce49a99a10175b0ce68685`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:58.499083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-719ec19c-a98a-4bd8-bd7a-021754632d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:58.532119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fb663-8a5b-4dca-bead-9c2662cf1ab7 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:58.546331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:58.547162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:58.547551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:58.547933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] PATH_INFO: `/v3/users/b5a39295f0894344bc99cc4824bfa698` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:58.549294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a39295f0894344bc99cc4824bfa698)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:58.551453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:58.608600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 820/1662] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:58.629008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ec19c-a98a-4bd8-bd7a-021754632d16 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:58.631136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-719ec19c-a98a-4bd8-bd7a-021754632d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:58.701800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a39295f0894344bc99cc4824bfa698'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:58.702806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a39295f0894344bc99cc4824bfa698'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:58.704434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a39295f0894344bc99cc4824bfa698'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:58.728905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a39295f0894344bc99cc4824bfa698'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:58.769028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c77a9c8-be32-4e03-8251-1355022d9808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a39295f0894344bc99cc4824bfa698'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:58.801625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 843/1663] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:26:58 2022] DELETE /identity/v3/users/b5a39295f0894344bc99cc4824bfa698 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:58.808453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fab2e-d367-45b8-b899-e504e024b9fc None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:58.808834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fab2e-d367-45b8-b899-e504e024b9fc None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:58.810277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fab2e-d367-45b8-b899-e504e024b9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:58.837244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:58.843859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f34fab2e-d367-45b8-b899-e504e024b9fc None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:58.846021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f34fab2e-d367-45b8-b899-e504e024b9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:58.879722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:58.897798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ec19c-a98a-4bd8-bd7a-021754632d16 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:58.996654 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 844/1664] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:58.997347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fab2e-d367-45b8-b899-e504e024b9fc None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:58.998853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f34fab2e-d367-45b8-b899-e504e024b9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:59.022230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fab2e-d367-45b8-b899-e504e024b9fc None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:59.027365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:59.028027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:59.028301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:59.028598 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] PATH_INFO: `/v3/users/e10a141a166449b78f1959e9331e6d73` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:59.033924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10a141a166449b78f1959e9331e6d73)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:59.047511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:59.052081 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d573f-035e-485f-a701-0ded220503c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:59.052829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d573f-035e-485f-a701-0ded220503c5 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:59.053110 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d573f-035e-485f-a701-0ded220503c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:59.053383 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d573f-035e-485f-a701-0ded220503c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:59.059963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7d5d573f-035e-485f-a701-0ded220503c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:59.184856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10a141a166449b78f1959e9331e6d73'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:59.187357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10a141a166449b78f1959e9331e6d73'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:59.189681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10a141a166449b78f1959e9331e6d73'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:59.197066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d573f-035e-485f-a701-0ded220503c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:59.198818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d573f-035e-485f-a701-0ded220503c5 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:59.201376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10a141a166449b78f1959e9331e6d73'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:59.219965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10a141a166449b78f1959e9331e6d73'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:59.228475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 821/1665] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:59.247688 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d573f-035e-485f-a701-0ded220503c5 service nova] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:59.250706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 845/1666] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:26:58 2022] DELETE /identity/v3/users/e10a141a166449b78f1959e9331e6d73 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:59.252120 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7d5d573f-035e-485f-a701-0ded220503c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:59.390719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d573f-035e-485f-a701-0ded220503c5 service nova] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:59.553928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8b718-e632-4b15-a948-ede4d37340db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:59.565166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8b718-e632-4b15-a948-ede4d37340db service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:59.565690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8b718-e632-4b15-a948-ede4d37340db service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:59.566188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8b718-e632-4b15-a948-ede4d37340db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:59.568572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-94d8b718-e632-4b15-a948-ede4d37340db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:59.576891 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:59.726716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8b718-e632-4b15-a948-ede4d37340db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:59.737695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8b718-e632-4b15-a948-ede4d37340db service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:59.784400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 822/1667] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:00.484309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:00.486859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:00.521805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498dd5a-ea1d-4649-b048-c61f8a50e5bf admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:00.531709 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:00.533794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:00.535378 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:00.539226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] PATH_INFO: `/v3/projects/04946d4a1ff64961acfa93fa3e5e0fd4` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:00.541882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04946d4a1ff64961acfa93fa3e5e0fd4)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:00.544283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:00.682493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04946d4a1ff64961acfa93fa3e5e0fd4', 'request_id': 'req-f67ca367-6772-4c37-a8a1-f7e7c96ec429'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:00.700199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04946d4a1ff64961acfa93fa3e5e0fd4', 'request_id': 'req-f67ca367-6772-4c37-a8a1-f7e7c96ec429'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:00.707364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04946d4a1ff64961acfa93fa3e5e0fd4', 'request_id': 'req-f67ca367-6772-4c37-a8a1-f7e7c96ec429'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:00.738750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] The token cache is being invalidate because project 04946d4a1ff64961acfa93fa3e5e0fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:00.739093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:00.740794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:00.742467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 846/1668] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:00 2022] DELETE /identity/v3/projects/04946d4a1ff64961acfa93fa3e5e0fd4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:00.747232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8b718-e632-4b15-a948-ede4d37340db service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:00.772723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8b718-e632-4b15-a948-ede4d37340db service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:00.954437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:00.957543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:00.958012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:00.959337 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] PATH_INFO: `/v3/users/9595ffbc5b7644f9b3d3d37ddacf3488` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:00.968820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9595ffbc5b7644f9b3d3d37ddacf3488)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:00.970364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: WARNING py.warnings [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:27:00.970364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: warnings.warn(msg) Sep 16 19:27:00.970364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: Sep 16 19:27:00.971953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:01.218348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9595ffbc5b7644f9b3d3d37ddacf3488'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:01.219113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9595ffbc5b7644f9b3d3d37ddacf3488'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:01.262838 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9595ffbc5b7644f9b3d3d37ddacf3488'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:01.331338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9595ffbc5b7644f9b3d3d37ddacf3488'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:01.332301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9595ffbc5b7644f9b3d3d37ddacf3488'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:01.362282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 823/1669] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:00 2022] DELETE /identity/v3/users/9595ffbc5b7644f9b3d3d37ddacf3488 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:02.549854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:02.552161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:02.578249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ca367-6772-4c37-a8a1-f7e7c96ec429 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:02.597054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:02.705879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:02.707493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:02.707493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:02.707493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] PATH_INFO: `/v3/users/fe4d1bebc3e74972b86cffac4388f493` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:02.709810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4d1bebc3e74972b86cffac4388f493)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:02.712127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:02.784107 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:02.789349 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:02.823952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f7066-bd71-4156-9ae8-e392745d76c9 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:02.826124 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4d1bebc3e74972b86cffac4388f493'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:02.828772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4d1bebc3e74972b86cffac4388f493'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:02.835932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4d1bebc3e74972b86cffac4388f493'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:02.848355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:02.858567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:02.858855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:02.859125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] PATH_INFO: `/v3/projects/b4b64a6a42f64b97827f79fff23015be` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:02.874650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b64a6a42f64b97827f79fff23015be)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:02.877772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:02.879287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4d1bebc3e74972b86cffac4388f493'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:02.920892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2e26a5f1-44ae-4d00-a1c9-e720f7f8f9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4d1bebc3e74972b86cffac4388f493'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:02.947161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:02.967701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 847/1670] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:02 2022] DELETE /identity/v3/users/fe4d1bebc3e74972b86cffac4388f493 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:02.972782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0790b6-4918-4690-9f8a-f1ba6488b35a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:02.973931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0790b6-4918-4690-9f8a-f1ba6488b35a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:02.977808 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0790b6-4918-4690-9f8a-f1ba6488b35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:03.053480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-cb0790b6-4918-4690-9f8a-f1ba6488b35a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:03.062236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cb0790b6-4918-4690-9f8a-f1ba6488b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:03.069223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b64a6a42f64b97827f79fff23015be', 'request_id': 'req-57dfbc3f-c958-497a-a6df-066272bc4650'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:03.087463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b64a6a42f64b97827f79fff23015be', 'request_id': 'req-57dfbc3f-c958-497a-a6df-066272bc4650'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:03.116641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b64a6a42f64b97827f79fff23015be', 'request_id': 'req-57dfbc3f-c958-497a-a6df-066272bc4650'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:03.148129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] The token cache is being invalidate because project b4b64a6a42f64b97827f79fff23015be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:03.148129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:03.151009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:03.152597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 824/1671] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:02 2022] DELETE /identity/v3/projects/b4b64a6a42f64b97827f79fff23015be => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:03.158996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:03.161002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:03.236753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 848/1672] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:03.244747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73819a1-9240-47dc-b97d-01009fe760f6 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:03.244747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73819a1-9240-47dc-b97d-01009fe760f6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:03.244747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73819a1-9240-47dc-b97d-01009fe760f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:03.326339 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-c73819a1-9240-47dc-b97d-01009fe760f6 None None] MFA Rules not processed for user `4160745043014f238450385a02367db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:03.326339 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c73819a1-9240-47dc-b97d-01009fe760f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:03.330931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfbc3f-c958-497a-a6df-066272bc4650 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:03.400109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:03.401211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:03.401731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:03.402202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] PATH_INFO: `/v3/users/e8b3b06d9bc744a59a4b0c7a90f245d3` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:03.409408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b3b06d9bc744a59a4b0c7a90f245d3)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:03.414740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:03.422326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:03.557674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b3b06d9bc744a59a4b0c7a90f245d3'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:03.558634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b3b06d9bc744a59a4b0c7a90f245d3'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:03.578953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b3b06d9bc744a59a4b0c7a90f245d3'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:03.610583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b3b06d9bc744a59a4b0c7a90f245d3'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:03.615761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b3b06d9bc744a59a4b0c7a90f245d3'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:03.621574 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 849/1673] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:03.622991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f371996-e2f1-48a8-b65a-bb563126542a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:03.623556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f371996-e2f1-48a8-b65a-bb563126542a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:03.623556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f371996-e2f1-48a8-b65a-bb563126542a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:03.647716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 825/1674] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:03 2022] DELETE /identity/v3/users/e8b3b06d9bc744a59a4b0c7a90f245d3 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:03.648616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:03.649978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:03.750313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-9f371996-e2f1-48a8-b65a-bb563126542a None None] MFA Rules not processed for user `e4681e0753e84aea8d453465a424e2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:03.751872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9f371996-e2f1-48a8-b65a-bb563126542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:03.755332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:03.864608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822247b-2f83-4a0d-a3af-1226e47dff3e admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:03.888410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917779e-f1ec-4b88-8500-4391bc279364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:03.889183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917779e-f1ec-4b88-8500-4391bc279364 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:03.889475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917779e-f1ec-4b88-8500-4391bc279364 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:03.889764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917779e-f1ec-4b88-8500-4391bc279364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:03.897413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6917779e-f1ec-4b88-8500-4391bc279364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:03.975202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 850/1675] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:03.988690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4efd6-34a6-4c50-a3de-818b6bc406d0 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:03.989146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4efd6-34a6-4c50-a3de-818b6bc406d0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:03.989668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4efd6-34a6-4c50-a3de-818b6bc406d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:04.030204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-18d4efd6-34a6-4c50-a3de-818b6bc406d0 None None] MFA Rules not processed for user `4160745043014f238450385a02367db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:04.032254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-18d4efd6-34a6-4c50-a3de-818b6bc406d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.079498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917779e-f1ec-4b88-8500-4391bc279364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:04.081507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917779e-f1ec-4b88-8500-4391bc279364 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:04.129896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 826/1676] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:04.130844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917779e-f1ec-4b88-8500-4391bc279364 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:04.132922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6917779e-f1ec-4b88-8500-4391bc279364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.152290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917779e-f1ec-4b88-8500-4391bc279364 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:04.159486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:04.161346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:04.161630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:04.162166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] PATH_INFO: `/v3/projects/2bb26df5a5a741f8a84f4b43aa052c91` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:04.164253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb26df5a5a741f8a84f4b43aa052c91)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:04.166352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 851/1677] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:04.168075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb96e-3f8f-49ac-9ff8-9950b5bf9d54 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:04.168484 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb96e-3f8f-49ac-9ff8-9950b5bf9d54 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:04.168855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb96e-3f8f-49ac-9ff8-9950b5bf9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:04.172612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:04.222874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-beeeb96e-3f8f-49ac-9ff8-9950b5bf9d54 None None] MFA Rules not processed for user `e4681e0753e84aea8d453465a424e2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:04.224254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-beeeb96e-3f8f-49ac-9ff8-9950b5bf9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.242854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 852/1678] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:04.243963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeeb96e-3f8f-49ac-9ff8-9950b5bf9d54 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:04.253696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-beeeb96e-3f8f-49ac-9ff8-9950b5bf9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.255537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb26df5a5a741f8a84f4b43aa052c91', 'request_id': 'req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.272252 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb26df5a5a741f8a84f4b43aa052c91', 'request_id': 'req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.294122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb26df5a5a741f8a84f4b43aa052c91', 'request_id': 'req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.329845 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] The token cache is being invalidate because project 2bb26df5a5a741f8a84f4b43aa052c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:04.330414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.331643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.334173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 827/1679] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:04 2022] DELETE /identity/v3/projects/2bb26df5a5a741f8a84f4b43aa052c91 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:04.335293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:04.337995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.383537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:04.429600 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeeb96e-3f8f-49ac-9ff8-9950b5bf9d54 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:04.485255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:04.541563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe29c5-09df-4bd1-8d46-f5fdd95717ee admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:04.557715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87aa9-3c69-4d53-9658-7495a211a3b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:04.559167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87aa9-3c69-4d53-9658-7495a211a3b1 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:04.559498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87aa9-3c69-4d53-9658-7495a211a3b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:04.559774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87aa9-3c69-4d53-9658-7495a211a3b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:04.562545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f0e87aa9-3c69-4d53-9658-7495a211a3b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.615064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347c492-dd92-4a06-8dfc-7e4dae66579a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:04.616059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c492-dd92-4a06-8dfc-7e4dae66579a service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:04.616524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c492-dd92-4a06-8dfc-7e4dae66579a service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:04.616981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c492-dd92-4a06-8dfc-7e4dae66579a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:04.621588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8347c492-dd92-4a06-8dfc-7e4dae66579a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.758981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87aa9-3c69-4d53-9658-7495a211a3b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:04.762039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87aa9-3c69-4d53-9658-7495a211a3b1 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:04.779649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 828/1680] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:04.781238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6997ba-3198-4563-bac4-e1e107a4f8ce None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:04.781613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6997ba-3198-4563-bac4-e1e107a4f8ce None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:04.781898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347c492-dd92-4a06-8dfc-7e4dae66579a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:04.782010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6997ba-3198-4563-bac4-e1e107a4f8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:04.786684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347c492-dd92-4a06-8dfc-7e4dae66579a service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:04.806749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-9f6997ba-3198-4563-bac4-e1e107a4f8ce None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:04.809649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9f6997ba-3198-4563-bac4-e1e107a4f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.819141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 853/1681] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:04.820402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347c492-dd92-4a06-8dfc-7e4dae66579a service nova] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:04.822171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8347c492-dd92-4a06-8dfc-7e4dae66579a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.999227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 829/1682] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:05.007028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fc7fe-6fc5-4fdc-85f9-49d2e57d1716 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.007028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fc7fe-6fc5-4fdc-85f9-49d2e57d1716 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.007028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fc7fe-6fc5-4fdc-85f9-49d2e57d1716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.039312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347c492-dd92-4a06-8dfc-7e4dae66579a service nova] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:05.056459 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:05.057713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.057942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.058507 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] PATH_INFO: `/v3/projects/d5da3952a897409380d15e1d52d31923` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.059806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5da3952a897409380d15e1d52d31923)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:05.062494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:05.075584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-208fc7fe-6fc5-4fdc-85f9-49d2e57d1716 None None] MFA Rules not processed for user `74d0de83f0e54dc8a3c85f2cbda50349`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:05.077270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-208fc7fe-6fc5-4fdc-85f9-49d2e57d1716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:05.161734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:05.188089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5da3952a897409380d15e1d52d31923', 'request_id': 'req-a0c8ffbe-41f0-42ea-95f3-715413f11a55'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:05.205473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5da3952a897409380d15e1d52d31923', 'request_id': 'req-a0c8ffbe-41f0-42ea-95f3-715413f11a55'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:05.219634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5da3952a897409380d15e1d52d31923', 'request_id': 'req-a0c8ffbe-41f0-42ea-95f3-715413f11a55'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:05.228424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 830/1683] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:05.230916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765313ef-8c1b-4e29-b4c9-7e621730943e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.230916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765313ef-8c1b-4e29-b4c9-7e621730943e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.232170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765313ef-8c1b-4e29-b4c9-7e621730943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.254711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] The token cache is being invalidate because project d5da3952a897409380d15e1d52d31923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:05.255246 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:05.256427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0c8ffbe-41f0-42ea-95f3-715413f11a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:05.258595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 854/1684] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:04 2022] DELETE /identity/v3/projects/d5da3952a897409380d15e1d52d31923 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:05.264771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47431-7cda-4054-95e6-9e615708514a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.265189 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47431-7cda-4054-95e6-9e615708514a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.266400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47431-7cda-4054-95e6-9e615708514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.281625 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-765313ef-8c1b-4e29-b4c9-7e621730943e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:05.283962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-765313ef-8c1b-4e29-b4c9-7e621730943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:05.303910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f8d47431-7cda-4054-95e6-9e615708514a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:05.306504 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f8d47431-7cda-4054-95e6-9e615708514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:05.319354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:05.426653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 831/1685] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:05.427746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765313ef-8c1b-4e29-b4c9-7e621730943e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:05.451038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765313ef-8c1b-4e29-b4c9-7e621730943e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:05.461415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 855/1686] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:05.463599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd60cb-d885-41c3-b98b-0fdf00432fd9 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.463942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd60cb-d885-41c3-b98b-0fdf00432fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.464366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd60cb-d885-41c3-b98b-0fdf00432fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.468303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c41dcb-7bb1-4d6c-9718-65b8b9e1cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:05.469342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c41dcb-7bb1-4d6c-9718-65b8b9e1cc9d admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.470549 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c41dcb-7bb1-4d6c-9718-65b8b9e1cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.470939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c41dcb-7bb1-4d6c-9718-65b8b9e1cc9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.473497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c41dcb-7bb1-4d6c-9718-65b8b9e1cc9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:05.474220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c41dcb-7bb1-4d6c-9718-65b8b9e1cc9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:05.480052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c41dcb-7bb1-4d6c-9718-65b8b9e1cc9d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:05.489203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-9dfd60cb-d885-41c3-b98b-0fdf00432fd9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:05.490501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9dfd60cb-d885-41c3-b98b-0fdf00432fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:05.504814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 856/1687] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:05.507158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd60cb-d885-41c3-b98b-0fdf00432fd9 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:05.522192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 832/1688] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:27:05.523130 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c41dcb-7bb1-4d6c-9718-65b8b9e1cc9d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:05.525252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd60cb-d885-41c3-b98b-0fdf00432fd9 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:05.537534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20594f6f-b113-4317-b01e-702f18586557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:05.544973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20594f6f-b113-4317-b01e-702f18586557 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.547117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20594f6f-b113-4317-b01e-702f18586557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.547518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20594f6f-b113-4317-b01e-702f18586557 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.549132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20594f6f-b113-4317-b01e-702f18586557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:05.549558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20594f6f-b113-4317-b01e-702f18586557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:05.551344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20594f6f-b113-4317-b01e-702f18586557 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:05.557833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c41dcb-7bb1-4d6c-9718-65b8b9e1cc9d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:05.565834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da59e8-4337-4908-91c4-077896955820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:05.566467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da59e8-4337-4908-91c4-077896955820 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.566764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da59e8-4337-4908-91c4-077896955820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.567157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da59e8-4337-4908-91c4-077896955820 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.567959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da59e8-4337-4908-91c4-077896955820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:05.573440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da59e8-4337-4908-91c4-077896955820 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:05.588239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 857/1689] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:27:05.589837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20594f6f-b113-4317-b01e-702f18586557 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:05.602245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20594f6f-b113-4317-b01e-702f18586557 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:05.609518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb2217-bc47-4fa7-b4c3-b250a7e86bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:05.610343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb2217-bc47-4fa7-b4c3-b250a7e86bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.610727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb2217-bc47-4fa7-b4c3-b250a7e86bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.611104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb2217-bc47-4fa7-b4c3-b250a7e86bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.611868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb2217-bc47-4fa7-b4c3-b250a7e86bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:05.621766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb2217-bc47-4fa7-b4c3-b250a7e86bc0 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:05.656478 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 833/1690] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:05 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:05.660736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a3372-71d5-463f-8182-82f8a084d4a1 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.661020 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a3372-71d5-463f-8182-82f8a084d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.661290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a3372-71d5-463f-8182-82f8a084d4a1 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.667485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 834/1692] 10.222.0.49 () {54 vars in 912 bytes} [Fri Sep 16 19:27:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:27:05.667694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 858/1692] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:05 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:05.668632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a3372-71d5-463f-8182-82f8a084d4a1 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:05.670006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357a620-0c56-44f4-ac64-1904cc058832 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.670621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357a620-0c56-44f4-ac64-1904cc058832 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.671215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357a620-0c56-44f4-ac64-1904cc058832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.760617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-9357a620-0c56-44f4-ac64-1904cc058832 None None] MFA Rules not processed for user `32ca32d96f9a436782ef0680f6b5dcac`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:05.768606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9357a620-0c56-44f4-ac64-1904cc058832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:05.786571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a3372-71d5-463f-8182-82f8a084d4a1 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:05.791935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56c79d-7f10-48d5-abbd-d92c3e7774ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:05.793220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56c79d-7f10-48d5-abbd-d92c3e7774ba admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.795407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56c79d-7f10-48d5-abbd-d92c3e7774ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.795846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56c79d-7f10-48d5-abbd-d92c3e7774ba admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.796694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56c79d-7f10-48d5-abbd-d92c3e7774ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:05.798932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56c79d-7f10-48d5-abbd-d92c3e7774ba admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:05.846926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 835/1693] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:05 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:05.849802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56c79d-7f10-48d5-abbd-d92c3e7774ba admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:05.860629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 859/1694] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:05.862171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d69c5-7a58-4b4c-9768-9d9b83dcf168 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.862584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d69c5-7a58-4b4c-9768-9d9b83dcf168 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.862962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d69c5-7a58-4b4c-9768-9d9b83dcf168 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.865110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 860/1695] 10.222.0.49 () {54 vars in 912 bytes} [Fri Sep 16 19:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:27:05.865503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d69c5-7a58-4b4c-9768-9d9b83dcf168 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:05.874669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56c79d-7f10-48d5-abbd-d92c3e7774ba admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:05.881081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d69c5-7a58-4b4c-9768-9d9b83dcf168 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:05.886491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4e922-92eb-4159-aea0-06fea140adbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:05.886993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b03ee-ede4-4f47-aceb-2a428125987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:05.887382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4e922-92eb-4159-aea0-06fea140adbc admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.887623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b03ee-ede4-4f47-aceb-2a428125987d admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.887850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4e922-92eb-4159-aea0-06fea140adbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.887950 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b03ee-ede4-4f47-aceb-2a428125987d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.888222 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b03ee-ede4-4f47-aceb-2a428125987d admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.888331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4e922-92eb-4159-aea0-06fea140adbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.889039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b03ee-ede4-4f47-aceb-2a428125987d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:05.889198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4e922-92eb-4159-aea0-06fea140adbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:05.892257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4e922-92eb-4159-aea0-06fea140adbc admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:05.894350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b03ee-ede4-4f47-aceb-2a428125987d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:05.899596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:05.911860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 861/1696] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:05.914747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69179-b9fc-4262-9279-0530b057b5c2 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.915358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69179-b9fc-4262-9279-0530b057b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.915965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69179-b9fc-4262-9279-0530b057b5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.942264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 836/1697] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:05 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:05.944090 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b03ee-ede4-4f47-aceb-2a428125987d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:05.947049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7d8b03ee-ede4-4f47-aceb-2a428125987d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:05.963213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-92b69179-b9fc-4262-9279-0530b057b5c2 None None] MFA Rules not processed for user `32ca32d96f9a436782ef0680f6b5dcac`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:05.964896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-92b69179-b9fc-4262-9279-0530b057b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:05.975724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b03ee-ede4-4f47-aceb-2a428125987d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:05.983308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe364ad-09ef-4dd1-b430-4e26206ba30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:05.984161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe364ad-09ef-4dd1-b430-4e26206ba30a service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.986762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe364ad-09ef-4dd1-b430-4e26206ba30a service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.987204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe364ad-09ef-4dd1-b430-4e26206ba30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.994723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 862/1698] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:05.996423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69179-b9fc-4262-9279-0530b057b5c2 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:06.000618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe364ad-09ef-4dd1-b430-4e26206ba30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:06.004167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe364ad-09ef-4dd1-b430-4e26206ba30a service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:06.016244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 837/1699] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:06.017535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe364ad-09ef-4dd1-b430-4e26206ba30a service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:06.021672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69179-b9fc-4262-9279-0530b057b5c2 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:06.028321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6bdc2-fff2-47a1-854b-fef5cde2de09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:06.029042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6bdc2-fff2-47a1-854b-fef5cde2de09 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:06.029394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6bdc2-fff2-47a1-854b-fef5cde2de09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:06.029789 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6bdc2-fff2-47a1-854b-fef5cde2de09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:06.030975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe364ad-09ef-4dd1-b430-4e26206ba30a service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:06.031340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6bdc2-fff2-47a1-854b-fef5cde2de09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:06.033603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6bdc2-fff2-47a1-854b-fef5cde2de09 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:06.037287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf58d5b-26b0-4af7-9600-968f9e65fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:06.038271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf58d5b-26b0-4af7-9600-968f9e65fe20 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:06.038551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf58d5b-26b0-4af7-9600-968f9e65fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:06.038823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf58d5b-26b0-4af7-9600-968f9e65fe20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:06.040051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf58d5b-26b0-4af7-9600-968f9e65fe20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:06.042396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf58d5b-26b0-4af7-9600-968f9e65fe20 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:06.049714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 863/1700] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:06.049714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6bdc2-fff2-47a1-854b-fef5cde2de09 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:06.050130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d2b6bdc2-fff2-47a1-854b-fef5cde2de09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.056633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 838/1701] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:06.058298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf58d5b-26b0-4af7-9600-968f9e65fe20 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:06.059902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ddf58d5b-26b0-4af7-9600-968f9e65fe20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.067548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6bdc2-fff2-47a1-854b-fef5cde2de09 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:06.075610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:06.076278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:06.076612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:06.076891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] PATH_INFO: `/v3/projects/cd4a7602dab34627b2847a572e39816b` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:06.077213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf58d5b-26b0-4af7-9600-968f9e65fe20 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:06.078887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4a7602dab34627b2847a572e39816b)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:06.082454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:06.083205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:06.083587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:06.083835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:06.084045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] PATH_INFO: `/v3/users/098075c218cb4e6dbfd873e9443a38c1` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:06.086074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=098075c218cb4e6dbfd873e9443a38c1)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:06.089441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:06.183508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:06.208062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4a7602dab34627b2847a572e39816b', 'request_id': 'req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:06.243809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098075c218cb4e6dbfd873e9443a38c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:06.244607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098075c218cb4e6dbfd873e9443a38c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:06.246295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4a7602dab34627b2847a572e39816b', 'request_id': 'req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:06.269617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4a7602dab34627b2847a572e39816b', 'request_id': 'req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:06.271700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098075c218cb4e6dbfd873e9443a38c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:06.293201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] The token cache is being invalidate because project cd4a7602dab34627b2847a572e39816b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:06.293559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:06.294967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:06.296869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 864/1702] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:06 2022] DELETE /identity/v3/projects/cd4a7602dab34627b2847a572e39816b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:06.301610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:06.302694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098075c218cb4e6dbfd873e9443a38c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:06.303457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098075c218cb4e6dbfd873e9443a38c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:06.307179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.329352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 839/1703] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:06 2022] DELETE /identity/v3/users/098075c218cb4e6dbfd873e9443a38c1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:06.332570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:06.332815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.445911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b3d56-3e17-4e16-9337-4a65635b0b5c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:06.492789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e6320-03c7-47e7-b7ff-4618d74b16dd admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:06.511267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aba8ea-c9ab-4011-bcb6-28d2e934ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:06.511970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aba8ea-c9ab-4011-bcb6-28d2e934ed34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:06.512253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aba8ea-c9ab-4011-bcb6-28d2e934ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:06.512784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aba8ea-c9ab-4011-bcb6-28d2e934ed34 admin admin] PATH_INFO: `/v3/projects/ef78547a2674427bb4cc59414797e1db/users/a2251f87b08947b5abc1fdee624a1479/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:06.561686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aba8ea-c9ab-4011-bcb6-28d2e934ed34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef78547a2674427bb4cc59414797e1db, user_id=a2251f87b08947b5abc1fdee624a1479, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:06.564444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aba8ea-c9ab-4011-bcb6-28d2e934ed34 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:06.575589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bda86-155f-4b77-9649-8271f62217b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:06.576227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bda86-155f-4b77-9649-8271f62217b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:06.576557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bda86-155f-4b77-9649-8271f62217b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:06.576833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bda86-155f-4b77-9649-8271f62217b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:06.582163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4f9bda86-155f-4b77-9649-8271f62217b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.604043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 840/1704] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:06 2022] PUT /identity/v3/projects/ef78547a2674427bb4cc59414797e1db/users/a2251f87b08947b5abc1fdee624a1479/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:06.604043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aba8ea-c9ab-4011-bcb6-28d2e934ed34 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:06.604043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-07aba8ea-c9ab-4011-bcb6-28d2e934ed34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.613473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bda86-155f-4b77-9649-8271f62217b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:06.633522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bda86-155f-4b77-9649-8271f62217b5 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:06.660439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 865/1705] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:06.661755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee89b3-8b07-4cfb-b449-3b4a10f66bae None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:06.662065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee89b3-8b07-4cfb-b449-3b4a10f66bae None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:06.672133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee89b3-8b07-4cfb-b449-3b4a10f66bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:06.717278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-2bee89b3-8b07-4cfb-b449-3b4a10f66bae None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:06.718548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2bee89b3-8b07-4cfb-b449-3b4a10f66bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.781716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aba8ea-c9ab-4011-bcb6-28d2e934ed34 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:06.792282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:06.799719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfca2f-babc-478e-a1c3-708e2057b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:06.800447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfca2f-babc-478e-a1c3-708e2057b6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:06.800740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfca2f-babc-478e-a1c3-708e2057b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:06.801017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfca2f-babc-478e-a1c3-708e2057b6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:06.801679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfca2f-babc-478e-a1c3-708e2057b6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:06.803318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfca2f-babc-478e-a1c3-708e2057b6e5 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:06.835673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 841/1706] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:06.837138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d3395-f938-40f3-8934-a41420ae2582 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:06.837623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d3395-f938-40f3-8934-a41420ae2582 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:06.837903 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d3395-f938-40f3-8934-a41420ae2582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:06.864267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 866/1707] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:06.866210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10f882-c6a4-42c7-a598-6debf3514eb3 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:06.866713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10f882-c6a4-42c7-a598-6debf3514eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:06.867162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10f882-c6a4-42c7-a598-6debf3514eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:06.889334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-352d3395-f938-40f3-8934-a41420ae2582 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:06.894510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-352d3395-f938-40f3-8934-a41420ae2582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.916463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 842/1708] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:06.918497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ce10f882-c6a4-42c7-a598-6debf3514eb3 None None] MFA Rules not processed for user `a2251f87b08947b5abc1fdee624a1479`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:06.925967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d3395-f938-40f3-8934-a41420ae2582 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:06.927934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ce10f882-c6a4-42c7-a598-6debf3514eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.929062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-352d3395-f938-40f3-8934-a41420ae2582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.973104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:07.040877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 867/1709] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:07.042506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b2c02-15ac-4c78-9444-e13de2872d85 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:07.042906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b2c02-15ac-4c78-9444-e13de2872d85 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:07.043380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b2c02-15ac-4c78-9444-e13de2872d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:07.087153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-018b2c02-15ac-4c78-9444-e13de2872d85 None None] MFA Rules not processed for user `92f0c702f8ce49a99a10175b0ce68685`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:07.091883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-018b2c02-15ac-4c78-9444-e13de2872d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:07.096845 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d3395-f938-40f3-8934-a41420ae2582 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:07.105984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730f3b3-856b-4dc3-b900-f0591ded861a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:07.106631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730f3b3-856b-4dc3-b900-f0591ded861a service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:07.107039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730f3b3-856b-4dc3-b900-f0591ded861a service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:07.107327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730f3b3-856b-4dc3-b900-f0591ded861a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:07.116426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7730f3b3-856b-4dc3-b900-f0591ded861a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:07.238927 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 868/1710] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:07.239891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b2c02-15ac-4c78-9444-e13de2872d85 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:07.245493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-018b2c02-15ac-4c78-9444-e13de2872d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:07.281236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730f3b3-856b-4dc3-b900-f0591ded861a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:07.283497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730f3b3-856b-4dc3-b900-f0591ded861a service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:07.313757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 843/1711] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:07.314924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730f3b3-856b-4dc3-b900-f0591ded861a service nova] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:07.348828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730f3b3-856b-4dc3-b900-f0591ded861a service nova] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:07.363318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af3060-2790-44db-8cec-9b136106c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:07.364017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af3060-2790-44db-8cec-9b136106c22f admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:07.364289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af3060-2790-44db-8cec-9b136106c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:07.367514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af3060-2790-44db-8cec-9b136106c22f admin admin] PATH_INFO: `/v3/projects/eae6aa52d0ea47399373c1bf8a9a0523/users/a1f74a1df6ae4e969da93eda5ac3ed97/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:07.374914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:07.389195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b2c02-15ac-4c78-9444-e13de2872d85 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:07.398293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f159002-c3d8-4386-9b09-6419ba228702 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:07.398943 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f159002-c3d8-4386-9b09-6419ba228702 service placement] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:07.399326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f159002-c3d8-4386-9b09-6419ba228702 service placement] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:07.399729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f159002-c3d8-4386-9b09-6419ba228702 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:07.410324 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5f159002-c3d8-4386-9b09-6419ba228702 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:07.416899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af3060-2790-44db-8cec-9b136106c22f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae6aa52d0ea47399373c1bf8a9a0523, user_id=a1f74a1df6ae4e969da93eda5ac3ed97, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:07.421243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af3060-2790-44db-8cec-9b136106c22f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:07.490156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 844/1712] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:07 2022] PUT /identity/v3/projects/eae6aa52d0ea47399373c1bf8a9a0523/users/a1f74a1df6ae4e969da93eda5ac3ed97/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:07.493691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d52da1-f037-4b36-a69e-199c9b72659b None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:07.494155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d52da1-f037-4b36-a69e-199c9b72659b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:07.494584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d52da1-f037-4b36-a69e-199c9b72659b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:07.532822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f159002-c3d8-4386-9b09-6419ba228702 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:07.535325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f159002-c3d8-4386-9b09-6419ba228702 service placement] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:07.594424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e2d52da1-f037-4b36-a69e-199c9b72659b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:07.596001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e2d52da1-f037-4b36-a69e-199c9b72659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:07.621298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 869/1713] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:07.624367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f159002-c3d8-4386-9b09-6419ba228702 service placement] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:07.635296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5f159002-c3d8-4386-9b09-6419ba228702 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:07.790001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f159002-c3d8-4386-9b09-6419ba228702 service placement] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:07.826104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 845/1714] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:07.827227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d52da1-f037-4b36-a69e-199c9b72659b None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:07.828893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e2d52da1-f037-4b36-a69e-199c9b72659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:07.870923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d52da1-f037-4b36-a69e-199c9b72659b None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:07.893235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67cce6-e40e-4266-8a51-e833ee219b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:07.893995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67cce6-e40e-4266-8a51-e833ee219b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:07.894349 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67cce6-e40e-4266-8a51-e833ee219b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:07.894707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67cce6-e40e-4266-8a51-e833ee219b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:07.895388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67cce6-e40e-4266-8a51-e833ee219b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:07.899473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67cce6-e40e-4266-8a51-e833ee219b6f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:07.957261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 846/1715] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:07 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:07.958719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67133e0-6ee2-4964-a05a-cb0acd21a74f None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:07.959002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67133e0-6ee2-4964-a05a-cb0acd21a74f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:07.959273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67133e0-6ee2-4964-a05a-cb0acd21a74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:07.985861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973b609-5a58-400e-857f-206f4598408c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:07.986132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973b609-5a58-400e-857f-206f4598408c service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:07.986459 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973b609-5a58-400e-857f-206f4598408c service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:07.987229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973b609-5a58-400e-857f-206f4598408c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:08.000794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973b609-5a58-400e-857f-206f4598408c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:08.002333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973b609-5a58-400e-857f-206f4598408c service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:08.014997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:08.017394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 870/1716] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:08.018518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973b609-5a58-400e-857f-206f4598408c service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:08.031217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973b609-5a58-400e-857f-206f4598408c service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:08.045131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-b67133e0-6ee2-4964-a05a-cb0acd21a74f None None] MFA Rules not processed for user `a1f74a1df6ae4e969da93eda5ac3ed97`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:08.046917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b67133e0-6ee2-4964-a05a-cb0acd21a74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:08.181962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 847/1717] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:08.181962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67133e0-6ee2-4964-a05a-cb0acd21a74f None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:08.230851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27ad8d-889d-4a34-84e1-32ca65b16516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:08.231499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27ad8d-889d-4a34-84e1-32ca65b16516 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:08.241575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27ad8d-889d-4a34-84e1-32ca65b16516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:08.242093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27ad8d-889d-4a34-84e1-32ca65b16516 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:08.242834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27ad8d-889d-4a34-84e1-32ca65b16516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:08.243146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27ad8d-889d-4a34-84e1-32ca65b16516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:08.244919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27ad8d-889d-4a34-84e1-32ca65b16516 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:08.299817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 871/1718] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:27:08.313079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c815d4-e856-451b-a4f8-30794247d8dc None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:08.313376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c815d4-e856-451b-a4f8-30794247d8dc None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:08.313661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c815d4-e856-451b-a4f8-30794247d8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:08.379854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-02c815d4-e856-451b-a4f8-30794247d8dc None None] MFA Rules not processed for user `e4681e0753e84aea8d453465a424e2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:08.381203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-02c815d4-e856-451b-a4f8-30794247d8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:08.473613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67133e0-6ee2-4964-a05a-cb0acd21a74f None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:08.506451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f6b90-826b-45cc-8cab-b3af4104bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:08.508532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f6b90-826b-45cc-8cab-b3af4104bd0e admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:08.508865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f6b90-826b-45cc-8cab-b3af4104bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:08.509137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f6b90-826b-45cc-8cab-b3af4104bd0e admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:08.509873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f6b90-826b-45cc-8cab-b3af4104bd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:08.512339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f6b90-826b-45cc-8cab-b3af4104bd0e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:08.524218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:08.595070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 848/1719] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:08 2022] POST /identity/v3/users => generated 292 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:08.600173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f6b90-826b-45cc-8cab-b3af4104bd0e admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:08.612510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 872/1720] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:08.613835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c815d4-e856-451b-a4f8-30794247d8dc None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:08.629667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f6b90-826b-45cc-8cab-b3af4104bd0e admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:08.633707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c815d4-e856-451b-a4f8-30794247d8dc None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:08.657752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ee552-1e31-42e0-9da4-1327b8c244d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:08.658540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137287-5511-4b33-b2c3-0548902b4c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:08.659477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ee552-1e31-42e0-9da4-1327b8c244d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:08.661413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137287-5511-4b33-b2c3-0548902b4c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:08.661727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137287-5511-4b33-b2c3-0548902b4c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:08.661967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137287-5511-4b33-b2c3-0548902b4c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:08.663115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ee552-1e31-42e0-9da4-1327b8c244d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:08.664906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ee552-1e31-42e0-9da4-1327b8c244d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:08.670019 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ee552-1e31-42e0-9da4-1327b8c244d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:08.671477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7137287-5511-4b33-b2c3-0548902b4c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:08.673835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ee552-1e31-42e0-9da4-1327b8c244d2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:08.677997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7137287-5511-4b33-b2c3-0548902b4c49 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:08.787389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 873/1721] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:08 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:08.788759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ee552-1e31-42e0-9da4-1327b8c244d2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:08.818138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 849/1722] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:08 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:08.820910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137287-5511-4b33-b2c3-0548902b4c49 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.017729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ee552-1e31-42e0-9da4-1327b8c244d2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.039595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9999b3-12a2-4b82-ab87-b40ee6e28e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.042898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9999b3-12a2-4b82-ab87-b40ee6e28e2e admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.043227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9999b3-12a2-4b82-ab87-b40ee6e28e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.043501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9999b3-12a2-4b82-ab87-b40ee6e28e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.044188 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9999b3-12a2-4b82-ab87-b40ee6e28e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.045875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9999b3-12a2-4b82-ab87-b40ee6e28e2e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.053786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137287-5511-4b33-b2c3-0548902b4c49 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.076364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eeed2-eabe-4d58-b4d4-fb06d710bc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.077030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eeed2-eabe-4d58-b4d4-fb06d710bc09 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.077302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eeed2-eabe-4d58-b4d4-fb06d710bc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.077949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eeed2-eabe-4d58-b4d4-fb06d710bc09 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.078203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eeed2-eabe-4d58-b4d4-fb06d710bc09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.083967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eeed2-eabe-4d58-b4d4-fb06d710bc09 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.098721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 874/1723] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:09.099639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9999b3-12a2-4b82-ab87-b40ee6e28e2e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.135600 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9999b3-12a2-4b82-ab87-b40ee6e28e2e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.153887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:09.154805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a83c85-bf3c-41cd-ad50-95b153893fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.156934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a83c85-bf3c-41cd-ad50-95b153893fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.157181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a83c85-bf3c-41cd-ad50-95b153893fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.157644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a83c85-bf3c-41cd-ad50-95b153893fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.158330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a83c85-bf3c-41cd-ad50-95b153893fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.160299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a83c85-bf3c-41cd-ad50-95b153893fb2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.165921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 850/1724] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:08 2022] POST /identity/v3/users => generated 294 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:09.165921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eeed2-eabe-4d58-b4d4-fb06d710bc09 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.192708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eeed2-eabe-4d58-b4d4-fb06d710bc09 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.206350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847b1f7-3861-42e1-95c9-e987a2701407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.208214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847b1f7-3861-42e1-95c9-e987a2701407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.208802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847b1f7-3861-42e1-95c9-e987a2701407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.209237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847b1f7-3861-42e1-95c9-e987a2701407 admin admin] PATH_INFO: `/v3/projects/071e2bb1c0d641c1910b396a9131747f/users/7c02d430562c41c6a0982456077c1bc5/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.223932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 875/1725] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:09 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:09.224891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a83c85-bf3c-41cd-ad50-95b153893fb2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.239932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847b1f7-3861-42e1-95c9-e987a2701407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071e2bb1c0d641c1910b396a9131747f, user_id=7c02d430562c41c6a0982456077c1bc5, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.245010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847b1f7-3861-42e1-95c9-e987a2701407 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.253716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a83c85-bf3c-41cd-ad50-95b153893fb2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.265162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5d22-06e9-461d-91b4-f2ed3879f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.266199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5d22-06e9-461d-91b4-f2ed3879f618 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.266471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5d22-06e9-461d-91b4-f2ed3879f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.266736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5d22-06e9-461d-91b4-f2ed3879f618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.267393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d5d22-06e9-461d-91b4-f2ed3879f618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.274947 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d5d22-06e9-461d-91b4-f2ed3879f618 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.296410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 851/1726] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:09 2022] PUT /identity/v3/projects/071e2bb1c0d641c1910b396a9131747f/users/7c02d430562c41c6a0982456077c1bc5/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:09.297707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847b1f7-3861-42e1-95c9-e987a2701407 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.315059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 876/1727] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:09.319158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5d22-06e9-461d-91b4-f2ed3879f618 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.353359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5d22-06e9-461d-91b4-f2ed3879f618 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.501679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847b1f7-3861-42e1-95c9-e987a2701407 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.517246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186272d-3876-4fc8-b942-5d813d2376be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.518181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186272d-3876-4fc8-b942-5d813d2376be admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.518581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186272d-3876-4fc8-b942-5d813d2376be admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.518864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186272d-3876-4fc8-b942-5d813d2376be admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.519639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186272d-3876-4fc8-b942-5d813d2376be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.521315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186272d-3876-4fc8-b942-5d813d2376be admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.557812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 852/1728] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:09.558810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186272d-3876-4fc8-b942-5d813d2376be admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.608281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60114-bb95-4ab5-b0d3-7527cadcfcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.609074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60114-bb95-4ab5-b0d3-7527cadcfcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.609354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60114-bb95-4ab5-b0d3-7527cadcfcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.609626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60114-bb95-4ab5-b0d3-7527cadcfcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.609740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186272d-3876-4fc8-b942-5d813d2376be admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.611272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef60114-bb95-4ab5-b0d3-7527cadcfcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.615069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef60114-bb95-4ab5-b0d3-7527cadcfcd9 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.636756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b567f-2625-4ae8-841b-95debc87adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.637406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b567f-2625-4ae8-841b-95debc87adc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.637682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b567f-2625-4ae8-841b-95debc87adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.637951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b567f-2625-4ae8-841b-95debc87adc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.640114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b567f-2625-4ae8-841b-95debc87adc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.641030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b567f-2625-4ae8-841b-95debc87adc8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.653073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 877/1729] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:09.654487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60114-bb95-4ab5-b0d3-7527cadcfcd9 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.680573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 853/1730] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:09.687815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b567f-2625-4ae8-841b-95debc87adc8 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.689024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60114-bb95-4ab5-b0d3-7527cadcfcd9 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.707084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cb72f-2232-4c93-864b-4c42da4b8fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.708134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cb72f-2232-4c93-864b-4c42da4b8fee admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.708650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cb72f-2232-4c93-864b-4c42da4b8fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.709071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cb72f-2232-4c93-864b-4c42da4b8fee admin admin] PATH_INFO: `/v3/projects/6b8948c0cfa749b8a1a4ba5fdc1b8fd4/users/c978659ee91d4bc5a9a48d70e4b2b228/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.728289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b567f-2625-4ae8-841b-95debc87adc8 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.735926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cb72f-2232-4c93-864b-4c42da4b8fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8948c0cfa749b8a1a4ba5fdc1b8fd4, user_id=c978659ee91d4bc5a9a48d70e4b2b228, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.741981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1435b1-9513-46f6-9b6f-d583340b27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.744195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1435b1-9513-46f6-9b6f-d583340b27db admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.745319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1435b1-9513-46f6-9b6f-d583340b27db admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.745609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1435b1-9513-46f6-9b6f-d583340b27db admin admin] PATH_INFO: `/v3/projects/071e2bb1c0d641c1910b396a9131747f/users/7c02d430562c41c6a0982456077c1bc5/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.746479 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cb72f-2232-4c93-864b-4c42da4b8fee admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.757104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1435b1-9513-46f6-9b6f-d583340b27db admin admin] RBAC: Authorizing `identity:create_grant(project_id=071e2bb1c0d641c1910b396a9131747f, user_id=7c02d430562c41c6a0982456077c1bc5, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.769108 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1435b1-9513-46f6-9b6f-d583340b27db admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.816293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 878/1731] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:09 2022] PUT /identity/v3/projects/6b8948c0cfa749b8a1a4ba5fdc1b8fd4/users/c978659ee91d4bc5a9a48d70e4b2b228/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:09.817257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cb72f-2232-4c93-864b-4c42da4b8fee admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.831474 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:09.850763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 854/1732] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:09 2022] PUT /identity/v3/projects/071e2bb1c0d641c1910b396a9131747f/users/7c02d430562c41c6a0982456077c1bc5/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:09.853574 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1435b1-9513-46f6-9b6f-d583340b27db admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.990165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cb72f-2232-4c93-864b-4c42da4b8fee admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:10.048558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1435b1-9513-46f6-9b6f-d583340b27db admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:10.065154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100c465-2196-4006-a213-a3765591707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:10.066164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100c465-2196-4006-a213-a3765591707d admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.066446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100c465-2196-4006-a213-a3765591707d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.066720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100c465-2196-4006-a213-a3765591707d admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.067378 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100c465-2196-4006-a213-a3765591707d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:10.069034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100c465-2196-4006-a213-a3765591707d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:10.100177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 855/1733] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:10.101842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b756196-4172-4050-bf52-069f6f2f22a3 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.102066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b756196-4172-4050-bf52-069f6f2f22a3 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.102337 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b756196-4172-4050-bf52-069f6f2f22a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.160489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d2197-74d2-4610-a398-0eb85c3912b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:10.161324 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d2197-74d2-4610-a398-0eb85c3912b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.161697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d2197-74d2-4610-a398-0eb85c3912b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.162105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d2197-74d2-4610-a398-0eb85c3912b5 admin admin] PATH_INFO: `/v3/projects/3c81454b74fe4d0792139217f3f2b81a/users/12732135ed83450d8f46f1c03ea9c10c/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.209657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d2197-74d2-4610-a398-0eb85c3912b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c81454b74fe4d0792139217f3f2b81a, user_id=12732135ed83450d8f46f1c03ea9c10c, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:10.222008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d2197-74d2-4610-a398-0eb85c3912b5 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:10.226621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2b756196-4172-4050-bf52-069f6f2f22a3 None None] MFA Rules not processed for user `7c02d430562c41c6a0982456077c1bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:10.228026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2b756196-4172-4050-bf52-069f6f2f22a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:10.271219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 879/1734] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:09 2022] PUT /identity/v3/projects/3c81454b74fe4d0792139217f3f2b81a/users/12732135ed83450d8f46f1c03ea9c10c/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:10.272532 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d2197-74d2-4610-a398-0eb85c3912b5 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:10.378511 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:10.421848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d2197-74d2-4610-a398-0eb85c3912b5 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:10.440731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c694000-ff64-4682-9c9b-09b2bff7accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:10.441591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c694000-ff64-4682-9c9b-09b2bff7accd admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.441948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c694000-ff64-4682-9c9b-09b2bff7accd admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.442345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c694000-ff64-4682-9c9b-09b2bff7accd admin admin] PATH_INFO: `/v3/projects/6b8948c0cfa749b8a1a4ba5fdc1b8fd4/users/c978659ee91d4bc5a9a48d70e4b2b228/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.449143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c694000-ff64-4682-9c9b-09b2bff7accd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8948c0cfa749b8a1a4ba5fdc1b8fd4, user_id=c978659ee91d4bc5a9a48d70e4b2b228, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:10.452014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c694000-ff64-4682-9c9b-09b2bff7accd admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:10.476787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 880/1735] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:10 2022] PUT /identity/v3/projects/6b8948c0cfa749b8a1a4ba5fdc1b8fd4/users/c978659ee91d4bc5a9a48d70e4b2b228/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:10.481213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e17bb-b5a4-47cd-9151-e9ae38f0aad5 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.481594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e17bb-b5a4-47cd-9151-e9ae38f0aad5 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.481967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e17bb-b5a4-47cd-9151-e9ae38f0aad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.506504 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 856/1736] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:10.507958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101177b-7c65-4692-b0fb-a26b4683d3f7 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.508252 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101177b-7c65-4692-b0fb-a26b4683d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.508558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101177b-7c65-4692-b0fb-a26b4683d3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.550580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-493e17bb-b5a4-47cd-9151-e9ae38f0aad5 None None] MFA Rules not processed for user `12732135ed83450d8f46f1c03ea9c10c`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:10.552182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-493e17bb-b5a4-47cd-9151-e9ae38f0aad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:10.603417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:10.607081 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f101177b-7c65-4692-b0fb-a26b4683d3f7 None None] MFA Rules not processed for user `c978659ee91d4bc5a9a48d70e4b2b228`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:10.612257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f101177b-7c65-4692-b0fb-a26b4683d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:10.775703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 857/1737] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:10.776853 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101177b-7c65-4692-b0fb-a26b4683d3f7 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:10.794296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 881/1738] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:10.795649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f101177b-7c65-4692-b0fb-a26b4683d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:10.796276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e17bb-b5a4-47cd-9151-e9ae38f0aad5 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:10.806179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-493e17bb-b5a4-47cd-9151-e9ae38f0aad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:10.958561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101177b-7c65-4692-b0fb-a26b4683d3f7 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:10.970093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193118-db90-4b4b-a1c7-3263a72c67c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:10.970986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193118-db90-4b4b-a1c7-3263a72c67c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.971181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193118-db90-4b4b-a1c7-3263a72c67c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.971539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193118-db90-4b4b-a1c7-3263a72c67c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.997294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e17bb-b5a4-47cd-9151-e9ae38f0aad5 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:11.024604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:11.029418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:11.030294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:11.030791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] PATH_INFO: `/v3/projects/60d215b03a484e52a042ffe1bb6115e4` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:11.032904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d215b03a484e52a042ffe1bb6115e4)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:11.036236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:11.119054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a193118-db90-4b4b-a1c7-3263a72c67c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:11.121012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a193118-db90-4b4b-a1c7-3263a72c67c6 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:11.154408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 858/1739] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:11.159470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193118-db90-4b4b-a1c7-3263a72c67c6 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:11.164140 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3a193118-db90-4b4b-a1c7-3263a72c67c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:11.170035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d215b03a484e52a042ffe1bb6115e4', 'request_id': 'req-4ecab374-3efe-4df9-883d-af110af0571e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:11.197459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:11.198769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d215b03a484e52a042ffe1bb6115e4', 'request_id': 'req-4ecab374-3efe-4df9-883d-af110af0571e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:11.210850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193118-db90-4b4b-a1c7-3263a72c67c6 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:11.219611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d215b03a484e52a042ffe1bb6115e4', 'request_id': 'req-4ecab374-3efe-4df9-883d-af110af0571e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:11.263553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] The token cache is being invalidate because project 60d215b03a484e52a042ffe1bb6115e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:11.263833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:11.267061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:11.281126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 882/1740] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:10 2022] DELETE /identity/v3/projects/60d215b03a484e52a042ffe1bb6115e4 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:11.282759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:11.289968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:11.420855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f3a32-fe8b-4faa-abe6-e1050501a0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:11.421592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f3a32-fe8b-4faa-abe6-e1050501a0fa service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:11.421873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f3a32-fe8b-4faa-abe6-e1050501a0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:11.422142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f3a32-fe8b-4faa-abe6-e1050501a0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:11.424357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b24f3a32-fe8b-4faa-abe6-e1050501a0fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:11.507693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:11.549325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecab374-3efe-4df9-883d-af110af0571e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:11.564131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e57d8-a6aa-4507-8453-3da419cf0cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:11.565115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e57d8-a6aa-4507-8453-3da419cf0cab admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:11.565496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e57d8-a6aa-4507-8453-3da419cf0cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:11.567093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e57d8-a6aa-4507-8453-3da419cf0cab admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:11.573586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e57d8-a6aa-4507-8453-3da419cf0cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:11.593031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e57d8-a6aa-4507-8453-3da419cf0cab admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:11.692202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f3a32-fe8b-4faa-abe6-e1050501a0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:11.694851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f3a32-fe8b-4faa-abe6-e1050501a0fa service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:11.705208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 883/1741] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:11 2022] POST /identity/v3/projects => generated 385 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:11.708083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7140e-0228-4e5f-a4cc-4f3315672cf4 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:11.708922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7140e-0228-4e5f-a4cc-4f3315672cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:11.710382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7140e-0228-4e5f-a4cc-4f3315672cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:11.739071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 859/1742] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:11.745001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f3a32-fe8b-4faa-abe6-e1050501a0fa service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:11.789359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f3a32-fe8b-4faa-abe6-e1050501a0fa service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:11.792481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-01d7140e-0228-4e5f-a4cc-4f3315672cf4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:11.796893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-01d7140e-0228-4e5f-a4cc-4f3315672cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:12.017579 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68da39-ba6a-48e4-b26f-40583ee37938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:12.018729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68da39-ba6a-48e4-b26f-40583ee37938 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:12.030699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 884/1743] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:12.034212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68da39-ba6a-48e4-b26f-40583ee37938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:12.034940 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68da39-ba6a-48e4-b26f-40583ee37938 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:12.039584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68da39-ba6a-48e4-b26f-40583ee37938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:12.040954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d342d6-8102-4364-a704-8b2f70c2d3ae None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:12.041940 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68da39-ba6a-48e4-b26f-40583ee37938 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:12.049658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d342d6-8102-4364-a704-8b2f70c2d3ae None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:12.050110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d342d6-8102-4364-a704-8b2f70c2d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:12.094194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-28d342d6-8102-4364-a704-8b2f70c2d3ae None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:12.095601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-28d342d6-8102-4364-a704-8b2f70c2d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:12.109009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 860/1744] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:11 2022] POST /identity/v3/users => generated 299 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:12.117708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68da39-ba6a-48e4-b26f-40583ee37938 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:12.160668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68da39-ba6a-48e4-b26f-40583ee37938 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:12.180975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 885/1745] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:12.186013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d342d6-8102-4364-a704-8b2f70c2d3ae None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:12.196774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1cdcf-e159-4589-a3b3-6919fa44cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:12.207086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1cdcf-e159-4589-a3b3-6919fa44cb97 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:12.207086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1cdcf-e159-4589-a3b3-6919fa44cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:12.207086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1cdcf-e159-4589-a3b3-6919fa44cb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:12.207347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1cdcf-e159-4589-a3b3-6919fa44cb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:12.209004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1cdcf-e159-4589-a3b3-6919fa44cb97 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:12.238401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d342d6-8102-4364-a704-8b2f70c2d3ae None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:12.275584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 861/1746] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:12.277382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22bec-eaac-4486-bd22-8ab54f1bae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:12.278005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22bec-eaac-4486-bd22-8ab54f1bae56 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:12.278394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22bec-eaac-4486-bd22-8ab54f1bae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:12.278552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22bec-eaac-4486-bd22-8ab54f1bae56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:12.279285 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22bec-eaac-4486-bd22-8ab54f1bae56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:12.279770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22bec-eaac-4486-bd22-8ab54f1bae56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:12.285789 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22bec-eaac-4486-bd22-8ab54f1bae56 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:12.295913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1cdcf-e159-4589-a3b3-6919fa44cb97 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:12.334515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 886/1747] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:27:12.344628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22bec-eaac-4486-bd22-8ab54f1bae56 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:12.360977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1cdcf-e159-4589-a3b3-6919fa44cb97 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:12.393609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22bec-eaac-4486-bd22-8ab54f1bae56 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:12.407408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b5335-28e8-4bab-bed3-fdf6a8ea714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:12.412052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b5335-28e8-4bab-bed3-fdf6a8ea714c admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:12.412340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b5335-28e8-4bab-bed3-fdf6a8ea714c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:12.412674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b5335-28e8-4bab-bed3-fdf6a8ea714c admin admin] PATH_INFO: `/v3/projects/ad14e343a3604412a4c95a734181f489/users/7682a61e8a444b48a209a2f8f65d1049/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:12.418773 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35136a-78c7-4eb7-ace5-bd34909af7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:12.419453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35136a-78c7-4eb7-ace5-bd34909af7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:12.419805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35136a-78c7-4eb7-ace5-bd34909af7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:12.420106 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35136a-78c7-4eb7-ace5-bd34909af7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:12.420916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35136a-78c7-4eb7-ace5-bd34909af7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:12.440427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35136a-78c7-4eb7-ace5-bd34909af7e8 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:12.496069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b5335-28e8-4bab-bed3-fdf6a8ea714c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad14e343a3604412a4c95a734181f489, user_id=7682a61e8a444b48a209a2f8f65d1049, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:12.498913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b5335-28e8-4bab-bed3-fdf6a8ea714c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:12.560998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 862/1748] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:12 2022] PUT /identity/v3/projects/ad14e343a3604412a4c95a734181f489/users/7682a61e8a444b48a209a2f8f65d1049/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:12.567184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b5335-28e8-4bab-bed3-fdf6a8ea714c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:12.608299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 887/1749] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:12 2022] POST /identity/v3/projects => generated 379 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:12.612757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35136a-78c7-4eb7-ace5-bd34909af7e8 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:12.614938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:12.856630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b5335-28e8-4bab-bed3-fdf6a8ea714c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:12.871212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35136a-78c7-4eb7-ace5-bd34909af7e8 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:12.888674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583eb68-dd09-4c08-a580-ea453ebbd6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:12.891528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583eb68-dd09-4c08-a580-ea453ebbd6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:12.892618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583eb68-dd09-4c08-a580-ea453ebbd6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:12.894913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583eb68-dd09-4c08-a580-ea453ebbd6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:12.902224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583eb68-dd09-4c08-a580-ea453ebbd6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:12.904139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f040c-a20f-4f4a-862b-8434ebe6b073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:12.906279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583eb68-dd09-4c08-a580-ea453ebbd6a1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:12.910125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f040c-a20f-4f4a-862b-8434ebe6b073 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:12.910417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f040c-a20f-4f4a-862b-8434ebe6b073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:12.910698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f040c-a20f-4f4a-862b-8434ebe6b073 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:12.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f040c-a20f-4f4a-862b-8434ebe6b073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:12.913495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f040c-a20f-4f4a-862b-8434ebe6b073 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:12.937298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 863/1750] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:12.938564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583eb68-dd09-4c08-a580-ea453ebbd6a1 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:12.958226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8583eb68-dd09-4c08-a580-ea453ebbd6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:12.989457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 888/1751] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:12 2022] POST /identity/v3/users => generated 290 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:12.991923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f040c-a20f-4f4a-862b-8434ebe6b073 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:13.000837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583eb68-dd09-4c08-a580-ea453ebbd6a1 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:13.014203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:13.016696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:13.018644 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:13.019086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] PATH_INFO: `/v3/users/a2251f87b08947b5abc1fdee624a1479` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:13.023028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2251f87b08947b5abc1fdee624a1479)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:13.026293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f040c-a20f-4f4a-862b-8434ebe6b073 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:13.027621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:13.043142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d5d3d-5694-4735-97b5-7cbcbf974804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:13.045277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d5d3d-5694-4735-97b5-7cbcbf974804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:13.045277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d5d3d-5694-4735-97b5-7cbcbf974804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:13.045536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d5d3d-5694-4735-97b5-7cbcbf974804 admin admin] PATH_INFO: `/v3/projects/ad14e343a3604412a4c95a734181f489/users/7682a61e8a444b48a209a2f8f65d1049/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:13.051633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d5d3d-5694-4735-97b5-7cbcbf974804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad14e343a3604412a4c95a734181f489, user_id=7682a61e8a444b48a209a2f8f65d1049, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:13.055429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d5d3d-5694-4735-97b5-7cbcbf974804 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:13.082580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 889/1752] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:12 2022] PUT /identity/v3/projects/ad14e343a3604412a4c95a734181f489/users/7682a61e8a444b48a209a2f8f65d1049/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:13.101548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d5d3d-5694-4735-97b5-7cbcbf974804 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:13.147632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:13.189793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2251f87b08947b5abc1fdee624a1479'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:13.190904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2251f87b08947b5abc1fdee624a1479'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:13.218351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2251f87b08947b5abc1fdee624a1479'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:13.277156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2251f87b08947b5abc1fdee624a1479'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:13.284893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0119a204-db13-4dfa-9369-1058c615ff35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2251f87b08947b5abc1fdee624a1479'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:13.344732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 864/1753] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:12 2022] DELETE /identity/v3/users/a2251f87b08947b5abc1fdee624a1479 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:13.344732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5da32-870d-4583-be3f-e8cf71f419cf None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:13.344732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5da32-870d-4583-be3f-e8cf71f419cf None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:13.344732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5da32-870d-4583-be3f-e8cf71f419cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:13.349346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d5d3d-5694-4735-97b5-7cbcbf974804 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:13.519506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914d3e9-6b6e-4195-8235-c8760df616c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:13.520213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914d3e9-6b6e-4195-8235-c8760df616c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:13.520628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914d3e9-6b6e-4195-8235-c8760df616c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:13.521000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914d3e9-6b6e-4195-8235-c8760df616c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:13.521829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914d3e9-6b6e-4195-8235-c8760df616c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:13.523546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914d3e9-6b6e-4195-8235-c8760df616c3 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:13.536235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-b1f5da32-870d-4583-be3f-e8cf71f419cf None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:13.537475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b1f5da32-870d-4583-be3f-e8cf71f419cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:13.544046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 890/1754] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:13.545151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14363a9f-080f-49f7-b928-480b5543ffb8 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:13.545151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14363a9f-080f-49f7-b928-480b5543ffb8 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:13.545591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14363a9f-080f-49f7-b928-480b5543ffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:13.648309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-14363a9f-080f-49f7-b928-480b5543ffb8 None None] MFA Rules not processed for user `7682a61e8a444b48a209a2f8f65d1049`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:13.657119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-14363a9f-080f-49f7-b928-480b5543ffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:13.684232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:13.724268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 865/1755] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:27:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:13.725978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb2c00-7ef7-4c8a-8d42-b660a9e7a93c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:13.726369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb2c00-7ef7-4c8a-8d42-b660a9e7a93c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:13.726800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb2c00-7ef7-4c8a-8d42-b660a9e7a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:13.767521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-56bb2c00-7ef7-4c8a-8d42-b660a9e7a93c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:13.769591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-56bb2c00-7ef7-4c8a-8d42-b660a9e7a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:13.783247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 866/1756] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:13.784193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb2c00-7ef7-4c8a-8d42-b660a9e7a93c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:13.790206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-56bb2c00-7ef7-4c8a-8d42-b660a9e7a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:13.814633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb2c00-7ef7-4c8a-8d42-b660a9e7a93c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:13.837515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 891/1757] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:13.843555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14363a9f-080f-49f7-b928-480b5543ffb8 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:13.845944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-14363a9f-080f-49f7-b928-480b5543ffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:13.850202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664402aa-8237-4d9e-9266-8f15dda524f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:13.850853 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664402aa-8237-4d9e-9266-8f15dda524f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:13.851133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664402aa-8237-4d9e-9266-8f15dda524f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:13.851403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664402aa-8237-4d9e-9266-8f15dda524f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:13.857865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664402aa-8237-4d9e-9266-8f15dda524f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:13.859517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664402aa-8237-4d9e-9266-8f15dda524f0 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:13.886460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14363a9f-080f-49f7-b928-480b5543ffb8 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:13.912313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 867/1758] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:13.914164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664402aa-8237-4d9e-9266-8f15dda524f0 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:13.922550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-664402aa-8237-4d9e-9266-8f15dda524f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:13.925066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:13.930453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:13.930890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:13.933229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] PATH_INFO: `/v3/users/a1f74a1df6ae4e969da93eda5ac3ed97` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:13.935412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f74a1df6ae4e969da93eda5ac3ed97)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:13.939718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:14.046656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:14.075215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664402aa-8237-4d9e-9266-8f15dda524f0 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:14.076141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f74a1df6ae4e969da93eda5ac3ed97'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:14.077380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f74a1df6ae4e969da93eda5ac3ed97'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:14.079813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f74a1df6ae4e969da93eda5ac3ed97'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:14.085435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b06ea-a987-47b1-9ca3-0f1f3914bd64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:14.088759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b06ea-a987-47b1-9ca3-0f1f3914bd64 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:14.089260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b06ea-a987-47b1-9ca3-0f1f3914bd64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:14.090713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b06ea-a987-47b1-9ca3-0f1f3914bd64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:14.097504 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b67b06ea-a987-47b1-9ca3-0f1f3914bd64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:14.107572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f74a1df6ae4e969da93eda5ac3ed97'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:14.129206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b06ea-a987-47b1-9ca3-0f1f3914bd64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:14.132690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b06ea-a987-47b1-9ca3-0f1f3914bd64 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:14.142170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f74a1df6ae4e969da93eda5ac3ed97'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:14.157237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 868/1759] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:14.157770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b06ea-a987-47b1-9ca3-0f1f3914bd64 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:14.162291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b67b06ea-a987-47b1-9ca3-0f1f3914bd64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:14.170579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 892/1760] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:13 2022] DELETE /identity/v3/users/a1f74a1df6ae4e969da93eda5ac3ed97 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:14.170579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:14.170912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:14.328004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b06ea-a987-47b1-9ca3-0f1f3914bd64 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:14.328815 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134db7a-20c5-4c4c-a864-e624e05c1f36 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:14.343590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d1e05-dc75-453e-93d6-2d425fdf494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:14.344139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d1e05-dc75-453e-93d6-2d425fdf494f admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:14.344458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d1e05-dc75-453e-93d6-2d425fdf494f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:14.344744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d1e05-dc75-453e-93d6-2d425fdf494f admin admin] PATH_INFO: `/v3/projects/3a283a5fbc884c5d9fdd1acfb11392b0/users/7a2423a1a144418ea2fb5e447c4a28aa/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:14.373171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d1e05-dc75-453e-93d6-2d425fdf494f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a283a5fbc884c5d9fdd1acfb11392b0, user_id=7a2423a1a144418ea2fb5e447c4a28aa, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:14.384169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d1e05-dc75-453e-93d6-2d425fdf494f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:14.411903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 893/1761] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:14 2022] PUT /identity/v3/projects/3a283a5fbc884c5d9fdd1acfb11392b0/users/7a2423a1a144418ea2fb5e447c4a28aa/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:14.412754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d1e05-dc75-453e-93d6-2d425fdf494f admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:14.425712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-163d1e05-dc75-453e-93d6-2d425fdf494f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:14.498428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60bd92-d97d-4031-ac2d-9716b1a0d5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:14.499396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60bd92-d97d-4031-ac2d-9716b1a0d5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:14.499872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60bd92-d97d-4031-ac2d-9716b1a0d5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:14.500281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60bd92-d97d-4031-ac2d-9716b1a0d5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:14.505593 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8d60bd92-d97d-4031-ac2d-9716b1a0d5c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:14.591280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:14.616300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d1e05-dc75-453e-93d6-2d425fdf494f admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:14.623182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0856d-0128-45d6-bc91-d6224daef497 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:14.623994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0856d-0128-45d6-bc91-d6224daef497 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:14.624474 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0856d-0128-45d6-bc91-d6224daef497 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:14.625066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0856d-0128-45d6-bc91-d6224daef497 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:14.628453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-51b0856d-0128-45d6-bc91-d6224daef497 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:14.644666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:14.650459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60bd92-d97d-4031-ac2d-9716b1a0d5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:14.653365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60bd92-d97d-4031-ac2d-9716b1a0d5c7 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:14.671083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 869/1762] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:14.673074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8d15-85a9-42ee-ab4b-0645761a6b2c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:14.673517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8d15-85a9-42ee-ab4b-0645761a6b2c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:14.674336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8d15-85a9-42ee-ab4b-0645761a6b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:14.732942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-a4fd8d15-85a9-42ee-ab4b-0645761a6b2c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:14.735855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a4fd8d15-85a9-42ee-ab4b-0645761a6b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:14.760632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0856d-0128-45d6-bc91-d6224daef497 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:14.762551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0856d-0128-45d6-bc91-d6224daef497 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:14.784266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 894/1763] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:27:14.787696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b97210-f6fe-4df3-bbad-fdd00100b340 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:14.788102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b97210-f6fe-4df3-bbad-fdd00100b340 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:14.789062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b97210-f6fe-4df3-bbad-fdd00100b340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:14.898073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-60b97210-f6fe-4df3-bbad-fdd00100b340 None None] MFA Rules not processed for user `7a2423a1a144418ea2fb5e447c4a28aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:14.903601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-60b97210-f6fe-4df3-bbad-fdd00100b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:14.956749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 870/1764] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:14.957894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd8d15-85a9-42ee-ab4b-0645761a6b2c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:14.964809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a4fd8d15-85a9-42ee-ab4b-0645761a6b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:15.021917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd8d15-85a9-42ee-ab4b-0645761a6b2c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:15.051283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:15.051999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:15.052284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:15.052671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] PATH_INFO: `/v3/users/12732135ed83450d8f46f1c03ea9c10c` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:15.068814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12732135ed83450d8f46f1c03ea9c10c)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:15.084524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:15.230610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12732135ed83450d8f46f1c03ea9c10c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:15.231539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12732135ed83450d8f46f1c03ea9c10c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:15.253808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12732135ed83450d8f46f1c03ea9c10c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:15.310933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12732135ed83450d8f46f1c03ea9c10c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:15.318918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12732135ed83450d8f46f1c03ea9c10c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:15.357789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 871/1765] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:14 2022] DELETE /identity/v3/users/12732135ed83450d8f46f1c03ea9c10c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:15.357789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:15.359652 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:15.382324 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 895/1766] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 596 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:15.387637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5476d-42c4-42ad-bbcc-2b4fe1ae9bf1 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:15.387949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5476d-42c4-42ad-bbcc-2b4fe1ae9bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:15.388233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5476d-42c4-42ad-bbcc-2b4fe1ae9bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:15.566532 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d6b5476d-42c4-42ad-bbcc-2b4fe1ae9bf1 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:15.578838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d6b5476d-42c4-42ad-bbcc-2b4fe1ae9bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:15.665495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6bc5c-04da-4460-a6f2-3612e5e94c78 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:15.689026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9f05-3d55-4211-966d-a659ac2095dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:15.689595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9f05-3d55-4211-966d-a659ac2095dc service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:15.689933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9f05-3d55-4211-966d-a659ac2095dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:15.690210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9f05-3d55-4211-966d-a659ac2095dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:15.710391 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f4af9f05-3d55-4211-966d-a659ac2095dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:15.728178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:15.907452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 896/1767] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:15.909042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5476d-42c4-42ad-bbcc-2b4fe1ae9bf1 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:15.926674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d6b5476d-42c4-42ad-bbcc-2b4fe1ae9bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:15.945702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9f05-3d55-4211-966d-a659ac2095dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:15.948532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9f05-3d55-4211-966d-a659ac2095dc service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:15.952117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5476d-42c4-42ad-bbcc-2b4fe1ae9bf1 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:15.965021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c5f6d-85c7-4298-9965-28ef13372872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:15.965680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c5f6d-85c7-4298-9965-28ef13372872 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:15.966452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c5f6d-85c7-4298-9965-28ef13372872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:15.966452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c5f6d-85c7-4298-9965-28ef13372872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:15.966878 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c5f6d-85c7-4298-9965-28ef13372872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:15.973982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c5f6d-85c7-4298-9965-28ef13372872 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:15.979869 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 872/1768] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:15.981688 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8491-2453-46bb-be7b-eeda0bd8fc23 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:15.982304 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8491-2453-46bb-be7b-eeda0bd8fc23 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:15.982797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8491-2453-46bb-be7b-eeda0bd8fc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:16.045088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 897/1769] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:15 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:16.045088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c5f6d-85c7-4298-9965-28ef13372872 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:16.046944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-238c5f6d-85c7-4298-9965-28ef13372872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:16.047063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ba7a8491-2453-46bb-be7b-eeda0bd8fc23 None None] MFA Rules not processed for user `32ca32d96f9a436782ef0680f6b5dcac`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:16.050178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ba7a8491-2453-46bb-be7b-eeda0bd8fc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:16.151646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:16.239242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c5f6d-85c7-4298-9965-28ef13372872 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:16.246448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80157c8e-dadb-416e-9858-6045e2e37899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:16.247341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157c8e-dadb-416e-9858-6045e2e37899 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:16.247771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157c8e-dadb-416e-9858-6045e2e37899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:16.248206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157c8e-dadb-416e-9858-6045e2e37899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:16.264505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 873/1770] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Sep 16 19:27:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:16.266738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8491-2453-46bb-be7b-eeda0bd8fc23 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:16.401237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8491-2453-46bb-be7b-eeda0bd8fc23 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:16.409380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6853-2772-4447-9e11-1ec50e217ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:16.411515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6853-2772-4447-9e11-1ec50e217ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:16.412111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6853-2772-4447-9e11-1ec50e217ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:16.412883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6853-2772-4447-9e11-1ec50e217ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:16.415219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80157c8e-dadb-416e-9858-6045e2e37899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:16.416332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd6853-2772-4447-9e11-1ec50e217ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:16.417152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80157c8e-dadb-416e-9858-6045e2e37899 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:16.421243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd6853-2772-4447-9e11-1ec50e217ca2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:16.445646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 898/1771] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:16.447064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08904c9a-114a-4a5b-a1cf-df7c89bc800d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:16.447449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08904c9a-114a-4a5b-a1cf-df7c89bc800d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:16.447906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08904c9a-114a-4a5b-a1cf-df7c89bc800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:16.472792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 874/1772] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:16 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:16.478270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-08904c9a-114a-4a5b-a1cf-df7c89bc800d None None] MFA Rules not processed for user `74d0de83f0e54dc8a3c85f2cbda50349`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:16.478942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6853-2772-4447-9e11-1ec50e217ca2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:16.481010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-08904c9a-114a-4a5b-a1cf-df7c89bc800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:16.519841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6853-2772-4447-9e11-1ec50e217ca2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:16.539061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaad2d-c696-4833-9532-1a8efe3a17fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:16.540472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaad2d-c696-4833-9532-1a8efe3a17fe admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:16.540984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaad2d-c696-4833-9532-1a8efe3a17fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:16.541487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaad2d-c696-4833-9532-1a8efe3a17fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:16.546870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eaad2d-c696-4833-9532-1a8efe3a17fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:16.552520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eaad2d-c696-4833-9532-1a8efe3a17fe admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:16.563681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 899/1773] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:16.564886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08904c9a-114a-4a5b-a1cf-df7c89bc800d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:16.579005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08904c9a-114a-4a5b-a1cf-df7c89bc800d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:16.583660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cf4ca-9055-4ae3-8ed6-711ecc6c7eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:16.584296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cf4ca-9055-4ae3-8ed6-711ecc6c7eaf service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:16.584608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cf4ca-9055-4ae3-8ed6-711ecc6c7eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:16.585433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cf4ca-9055-4ae3-8ed6-711ecc6c7eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:16.596627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cf4ca-9055-4ae3-8ed6-711ecc6c7eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:16.598613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cf4ca-9055-4ae3-8ed6-711ecc6c7eaf service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:16.614877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 900/1774] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:16.618244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 875/1775] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:16.628288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cf4ca-9055-4ae3-8ed6-711ecc6c7eaf service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:16.645750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cf4ca-9055-4ae3-8ed6-711ecc6c7eaf service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:16.663843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81cb63-915f-4a99-b819-047eebcf8217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:16.664629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81cb63-915f-4a99-b819-047eebcf8217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:16.664908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81cb63-915f-4a99-b819-047eebcf8217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:16.665188 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81cb63-915f-4a99-b819-047eebcf8217 admin admin] PATH_INFO: `/v3/projects/01d9afcfb5aa4277ac0ea8a3ac8dd649/users/11d9a8bbe8f74172951e0ad277f100d0/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:16.695247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81cb63-915f-4a99-b819-047eebcf8217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d9afcfb5aa4277ac0ea8a3ac8dd649, user_id=11d9a8bbe8f74172951e0ad277f100d0, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:16.711990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81cb63-915f-4a99-b819-047eebcf8217 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:16.741153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 901/1776] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:16 2022] PUT /identity/v3/projects/01d9afcfb5aa4277ac0ea8a3ac8dd649/users/11d9a8bbe8f74172951e0ad277f100d0/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:16.750025 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaad2d-c696-4833-9532-1a8efe3a17fe admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:16.776701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaad2d-c696-4833-9532-1a8efe3a17fe admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:16.857710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:16.919784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b65fb-9567-4f91-b94b-400ec0df2ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:16.921736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b65fb-9567-4f91-b94b-400ec0df2ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:16.922380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b65fb-9567-4f91-b94b-400ec0df2ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:16.922669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b65fb-9567-4f91-b94b-400ec0df2ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:16.925777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b65fb-9567-4f91-b94b-400ec0df2ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:16.928533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b65fb-9567-4f91-b94b-400ec0df2ad2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:16.965738 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81cb63-915f-4a99-b819-047eebcf8217 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:16.978015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 876/1777] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:16.980240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81cb63-915f-4a99-b819-047eebcf8217 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:16.986200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ca9a7-99b2-4dee-b47a-dff3a1734a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:16.987570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ca9a7-99b2-4dee-b47a-dff3a1734a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:16.987776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ca9a7-99b2-4dee-b47a-dff3a1734a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:16.988055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ca9a7-99b2-4dee-b47a-dff3a1734a4a admin admin] PATH_INFO: `/v3/projects/01d9afcfb5aa4277ac0ea8a3ac8dd649/users/11d9a8bbe8f74172951e0ad277f100d0/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:16.990225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ca9a7-99b2-4dee-b47a-dff3a1734a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d9afcfb5aa4277ac0ea8a3ac8dd649, user_id=11d9a8bbe8f74172951e0ad277f100d0, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:16.993054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ca9a7-99b2-4dee-b47a-dff3a1734a4a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:17.034395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6877ac-cfa8-4709-a73e-49b4fb6a650d None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:17.034702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6877ac-cfa8-4709-a73e-49b4fb6a650d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:17.034956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6877ac-cfa8-4709-a73e-49b4fb6a650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:17.041083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 902/1778] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:16 2022] PUT /identity/v3/projects/01d9afcfb5aa4277ac0ea8a3ac8dd649/users/11d9a8bbe8f74172951e0ad277f100d0/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:17.096013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-df6877ac-cfa8-4709-a73e-49b4fb6a650d None None] MFA Rules not processed for user `11d9a8bbe8f74172951e0ad277f100d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:17.097655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-df6877ac-cfa8-4709-a73e-49b4fb6a650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:17.286768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 877/1779] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:17.302262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ca9a7-99b2-4dee-b47a-dff3a1734a4a admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:17.308004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-dd5ca9a7-99b2-4dee-b47a-dff3a1734a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:17.434929 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:17.537459 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ca9a7-99b2-4dee-b47a-dff3a1734a4a admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:17.548497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca66ee1-711b-4e19-9bed-0a2864234d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:17.549363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca66ee1-711b-4e19-9bed-0a2864234d9d service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:17.549732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca66ee1-711b-4e19-9bed-0a2864234d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:17.550162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca66ee1-711b-4e19-9bed-0a2864234d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:17.587306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca66ee1-711b-4e19-9bed-0a2864234d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:17.589824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca66ee1-711b-4e19-9bed-0a2864234d9d service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:17.662887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 903/1780] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:17.785646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6877ac-cfa8-4709-a73e-49b4fb6a650d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:17.796847 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6877ac-cfa8-4709-a73e-49b4fb6a650d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:17.803661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7b453-a447-4ff6-821e-55d87d4c2e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:17.805543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7b453-a447-4ff6-821e-55d87d4c2e9e service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:17.805831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7b453-a447-4ff6-821e-55d87d4c2e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:17.806495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7b453-a447-4ff6-821e-55d87d4c2e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:17.912528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7b453-a447-4ff6-821e-55d87d4c2e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:17.916480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7b453-a447-4ff6-821e-55d87d4c2e9e service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:17.945455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 878/1781] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:18.463082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca66ee1-711b-4e19-9bed-0a2864234d9d service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:18.464742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2ca66ee1-711b-4e19-9bed-0a2864234d9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:18.648621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca66ee1-711b-4e19-9bed-0a2864234d9d service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:18.667884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:18.668619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:18.668897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:18.669341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] PATH_INFO: `/v3/projects/ef78547a2674427bb4cc59414797e1db` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:18.671005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef78547a2674427bb4cc59414797e1db)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:18.673187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:18.774866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef78547a2674427bb4cc59414797e1db', 'request_id': 'req-11522773-4051-4cb2-a07c-e77e199f2818'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:18.790847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef78547a2674427bb4cc59414797e1db', 'request_id': 'req-11522773-4051-4cb2-a07c-e77e199f2818'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:18.800867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef78547a2674427bb4cc59414797e1db', 'request_id': 'req-11522773-4051-4cb2-a07c-e77e199f2818'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:18.823867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] The token cache is being invalidate because project ef78547a2674427bb4cc59414797e1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:18.824640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:18.825617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:18.830520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 904/1782] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:18 2022] DELETE /identity/v3/projects/ef78547a2674427bb4cc59414797e1db => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:18.831808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7b453-a447-4ff6-821e-55d87d4c2e9e service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:18.849020 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7b453-a447-4ff6-821e-55d87d4c2e9e service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:18.957128 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:19.027057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:19.029131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:19.029427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:19.029972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] PATH_INFO: `/v3/users/7c02d430562c41c6a0982456077c1bc5` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:19.031802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c02d430562c41c6a0982456077c1bc5)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:19.036233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:19.064458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:19.066559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:19.096343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522773-4051-4cb2-a07c-e77e199f2818 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:19.115290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:19.116587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:19.117099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:19.117754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] PATH_INFO: `/v3/projects/eae6aa52d0ea47399373c1bf8a9a0523` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:19.120433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae6aa52d0ea47399373c1bf8a9a0523)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:19.125345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:19.170771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c02d430562c41c6a0982456077c1bc5'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.175627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c02d430562c41c6a0982456077c1bc5'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.210548 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c02d430562c41c6a0982456077c1bc5'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.254333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c02d430562c41c6a0982456077c1bc5'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.256284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c02d430562c41c6a0982456077c1bc5'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.274119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae6aa52d0ea47399373c1bf8a9a0523', 'request_id': 'req-208ae4fa-f890-4877-ac2a-cc4c42238f3d'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.291148 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae6aa52d0ea47399373c1bf8a9a0523', 'request_id': 'req-208ae4fa-f890-4877-ac2a-cc4c42238f3d'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.292860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:19.308117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae6aa52d0ea47399373c1bf8a9a0523', 'request_id': 'req-208ae4fa-f890-4877-ac2a-cc4c42238f3d'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.318142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 879/1783] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:18 2022] DELETE /identity/v3/users/7c02d430562c41c6a0982456077c1bc5 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:19.331365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] The token cache is being invalidate because project eae6aa52d0ea47399373c1bf8a9a0523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:19.331730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.332330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.335349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 905/1784] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:19 2022] DELETE /identity/v3/projects/eae6aa52d0ea47399373c1bf8a9a0523 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:19.343591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:19.350699 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:19.354682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:19.356831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:19.563959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ae4fa-f890-4877-ac2a-cc4c42238f3d admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:19.582910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:19.583945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:19.584359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:19.584730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] PATH_INFO: `/v3/projects/3c81454b74fe4d0792139217f3f2b81a` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:19.585930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38620c48-95fd-41d1-81ee-563ad820e516 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:19.586128 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c81454b74fe4d0792139217f3f2b81a)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:19.588548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:19.614389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:19.615058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:19.615346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:19.615622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] PATH_INFO: `/v3/users/c978659ee91d4bc5a9a48d70e4b2b228` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:19.624531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c978659ee91d4bc5a9a48d70e4b2b228)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:19.626555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:19.723680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c81454b74fe4d0792139217f3f2b81a', 'request_id': 'req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.757501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c978659ee91d4bc5a9a48d70e4b2b228'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.757738 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c81454b74fe4d0792139217f3f2b81a', 'request_id': 'req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.759494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c978659ee91d4bc5a9a48d70e4b2b228'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.773009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c81454b74fe4d0792139217f3f2b81a', 'request_id': 'req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.787825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c978659ee91d4bc5a9a48d70e4b2b228'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.796169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] The token cache is being invalidate because project 3c81454b74fe4d0792139217f3f2b81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:19.796494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.799359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.801472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 906/1785] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:19 2022] DELETE /identity/v3/projects/3c81454b74fe4d0792139217f3f2b81a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:19.805471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:19.807262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:19.824144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:19.829158 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c978659ee91d4bc5a9a48d70e4b2b228'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.831126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c978659ee91d4bc5a9a48d70e4b2b228'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:19.862735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 880/1786] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:19 2022] DELETE /identity/v3/users/c978659ee91d4bc5a9a48d70e4b2b228 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:19.948471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e15ec-afdb-4eb4-b7f1-ea5e1c9ac7bb admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:19.971769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:20.106048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:20.106731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:20.107029 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:20.107395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] PATH_INFO: `/v3/users/7682a61e8a444b48a209a2f8f65d1049` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:20.111031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7682a61e8a444b48a209a2f8f65d1049)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:20.113070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:20.362700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7682a61e8a444b48a209a2f8f65d1049'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:20.363611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7682a61e8a444b48a209a2f8f65d1049'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:20.364319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7682a61e8a444b48a209a2f8f65d1049'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:20.399167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7682a61e8a444b48a209a2f8f65d1049'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:20.497699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7682a61e8a444b48a209a2f8f65d1049'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:20.565351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 907/1787] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:19 2022] DELETE /identity/v3/users/7682a61e8a444b48a209a2f8f65d1049 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:21.131576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:21.137957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:21.165649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91a701-b2db-4e6d-b4b2-ca6759172df4 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:21.222642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:21.227395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:21.441535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:21.442325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:21.443102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:21.443627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] PATH_INFO: `/v3/projects/071e2bb1c0d641c1910b396a9131747f` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:21.444846 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f51c5e-0fec-413a-89ce-f383a5917de7 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:21.455985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] RBAC: Authorizing `identity:delete_project(project_id=071e2bb1c0d641c1910b396a9131747f)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:21.461580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:21.461770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:21.462532 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:21.462914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:21.465843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] PATH_INFO: `/v3/projects/6b8948c0cfa749b8a1a4ba5fdc1b8fd4` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:21.467173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8948c0cfa749b8a1a4ba5fdc1b8fd4)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:21.469477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:21.602922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:21.620041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8948c0cfa749b8a1a4ba5fdc1b8fd4', 'request_id': 'req-0b9099c3-dab2-47a4-8e45-79e16731df59'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:21.622942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8948c0cfa749b8a1a4ba5fdc1b8fd4', 'request_id': 'req-0b9099c3-dab2-47a4-8e45-79e16731df59'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:21.638786 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8948c0cfa749b8a1a4ba5fdc1b8fd4', 'request_id': 'req-0b9099c3-dab2-47a4-8e45-79e16731df59'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:21.667208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] The token cache is being invalidate because project 6b8948c0cfa749b8a1a4ba5fdc1b8fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:21.668931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:21.669871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0b9099c3-dab2-47a4-8e45-79e16731df59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:21.676776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 908/1788] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:21 2022] DELETE /identity/v3/projects/6b8948c0cfa749b8a1a4ba5fdc1b8fd4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:21.682308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154e79-07fa-4f92-9489-395d84689977 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:21.682600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071e2bb1c0d641c1910b396a9131747f', 'request_id': 'req-91d815ec-f56c-467f-b8f4-6fdc25d1343b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:21.682720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154e79-07fa-4f92-9489-395d84689977 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:21.682898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154e79-07fa-4f92-9489-395d84689977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:21.712157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071e2bb1c0d641c1910b396a9131747f', 'request_id': 'req-91d815ec-f56c-467f-b8f4-6fdc25d1343b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:21.725103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071e2bb1c0d641c1910b396a9131747f', 'request_id': 'req-91d815ec-f56c-467f-b8f4-6fdc25d1343b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:21.760872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-16154e79-07fa-4f92-9489-395d84689977 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:21.762122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-16154e79-07fa-4f92-9489-395d84689977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:21.777841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] The token cache is being invalidate because project 071e2bb1c0d641c1910b396a9131747f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:21.778249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:21.779026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-91d815ec-f56c-467f-b8f4-6fdc25d1343b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:21.787771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 881/1789] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:21 2022] DELETE /identity/v3/projects/071e2bb1c0d641c1910b396a9131747f => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:21.789784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33964-b6bd-4c83-bb8c-da41aee25a60 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:21.790522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33964-b6bd-4c83-bb8c-da41aee25a60 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:21.790979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33964-b6bd-4c83-bb8c-da41aee25a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:21.870829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-95e33964-b6bd-4c83-bb8c-da41aee25a60 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:21.879375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-95e33964-b6bd-4c83-bb8c-da41aee25a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:21.964173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 909/1790] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:21.966265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1864d3-cf29-4c73-842d-559ea115a996 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:21.966612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1864d3-cf29-4c73-842d-559ea115a996 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:21.967487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1864d3-cf29-4c73-842d-559ea115a996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:22.020282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8e1864d3-cf29-4c73-842d-559ea115a996 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:22.021492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8e1864d3-cf29-4c73-842d-559ea115a996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:22.042245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 910/1791] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:22.043839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1864d3-cf29-4c73-842d-559ea115a996 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:22.079120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1864d3-cf29-4c73-842d-559ea115a996 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:22.110379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cb043-183b-4dcf-a8ca-08cb41c7c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:22.111596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cb043-183b-4dcf-a8ca-08cb41c7c884 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:22.111596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cb043-183b-4dcf-a8ca-08cb41c7c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:22.111815 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cb043-183b-4dcf-a8ca-08cb41c7c884 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:22.112366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cb043-183b-4dcf-a8ca-08cb41c7c884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:22.112705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cb043-183b-4dcf-a8ca-08cb41c7c884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:22.125940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cb043-183b-4dcf-a8ca-08cb41c7c884 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:22.152769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 911/1792] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:27:22.156910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cb043-183b-4dcf-a8ca-08cb41c7c884 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:22.182554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cb043-183b-4dcf-a8ca-08cb41c7c884 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:22.198928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369433dc-3bd8-4bb8-a86a-79962d34c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:22.200293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369433dc-3bd8-4bb8-a86a-79962d34c923 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:22.200633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369433dc-3bd8-4bb8-a86a-79962d34c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:22.202684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369433dc-3bd8-4bb8-a86a-79962d34c923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:22.204400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369433dc-3bd8-4bb8-a86a-79962d34c923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:22.208174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369433dc-3bd8-4bb8-a86a-79962d34c923 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:22.221071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 882/1793] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:22.230006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ade4b1-5bb9-45f1-9e1d-1b9be7e664f2 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:22.231368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ade4b1-5bb9-45f1-9e1d-1b9be7e664f2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:22.232829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ade4b1-5bb9-45f1-9e1d-1b9be7e664f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:22.367261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-29ade4b1-5bb9-45f1-9e1d-1b9be7e664f2 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:22.397878 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-29ade4b1-5bb9-45f1-9e1d-1b9be7e664f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:22.410468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 912/1794] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:22 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:22.414596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369433dc-3bd8-4bb8-a86a-79962d34c923 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:22.445751 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:22.611211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 883/1795] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:22.614809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369433dc-3bd8-4bb8-a86a-79962d34c923 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:22.617642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ade4b1-5bb9-45f1-9e1d-1b9be7e664f2 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:22.633124 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321bf7e-46c6-455a-8dfb-1d24778bb9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:22.634191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bf7e-46c6-455a-8dfb-1d24778bb9fb admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:22.634795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bf7e-46c6-455a-8dfb-1d24778bb9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:22.635228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bf7e-46c6-455a-8dfb-1d24778bb9fb admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:22.637977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321bf7e-46c6-455a-8dfb-1d24778bb9fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:22.640791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321bf7e-46c6-455a-8dfb-1d24778bb9fb admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:22.643658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ade4b1-5bb9-45f1-9e1d-1b9be7e664f2 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:22.671415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030bb9a-13c3-4b85-9bee-4d5584c1bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:22.672928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030bb9a-13c3-4b85-9bee-4d5584c1bde6 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:22.674159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030bb9a-13c3-4b85-9bee-4d5584c1bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:22.675264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030bb9a-13c3-4b85-9bee-4d5584c1bde6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:22.678270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030bb9a-13c3-4b85-9bee-4d5584c1bde6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:22.679345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030bb9a-13c3-4b85-9bee-4d5584c1bde6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:22.687744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030bb9a-13c3-4b85-9bee-4d5584c1bde6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:22.698659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 913/1796] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:22 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:22.703312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321bf7e-46c6-455a-8dfb-1d24778bb9fb admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:22.740645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321bf7e-46c6-455a-8dfb-1d24778bb9fb admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:22.742715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 884/1797] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:27:22.748588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b02c91-f53a-4e25-bd88-096acdd5a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:22.748744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030bb9a-13c3-4b85-9bee-4d5584c1bde6 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:22.749358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02c91-f53a-4e25-bd88-096acdd5a32f admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:22.749845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02c91-f53a-4e25-bd88-096acdd5a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:22.750130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02c91-f53a-4e25-bd88-096acdd5a32f admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:22.751273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02c91-f53a-4e25-bd88-096acdd5a32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:22.756799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02c91-f53a-4e25-bd88-096acdd5a32f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:22.767857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030bb9a-13c3-4b85-9bee-4d5584c1bde6 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:22.782040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a3ad9-50b5-45ed-93db-023b25629805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:22.782259 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 914/1798] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:22.782351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a3ad9-50b5-45ed-93db-023b25629805 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:22.782351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a3ad9-50b5-45ed-93db-023b25629805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:22.782351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a3ad9-50b5-45ed-93db-023b25629805 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:22.782351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a3ad9-50b5-45ed-93db-023b25629805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:22.783992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a3ad9-50b5-45ed-93db-023b25629805 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:22.790814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b02c91-f53a-4e25-bd88-096acdd5a32f admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:22.873471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b02c91-f53a-4e25-bd88-096acdd5a32f admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:22.879473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 885/1799] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:22 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:22.881888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a3ad9-50b5-45ed-93db-023b25629805 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:22.886388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e3b8-24cb-49a3-858c-7bbabf0fc24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:22.890383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e3b8-24cb-49a3-858c-7bbabf0fc24f admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:22.890673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e3b8-24cb-49a3-858c-7bbabf0fc24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:22.890945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e3b8-24cb-49a3-858c-7bbabf0fc24f admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:22.892232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e3b8-24cb-49a3-858c-7bbabf0fc24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:22.894167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e3b8-24cb-49a3-858c-7bbabf0fc24f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:22.901957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:22.935046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 915/1800] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:22.938884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e3b8-24cb-49a3-858c-7bbabf0fc24f admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:22.957484 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e3b8-24cb-49a3-858c-7bbabf0fc24f admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:23.069126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a3ad9-50b5-45ed-93db-023b25629805 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:23.078627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6553f27-7cab-4c42-9b8d-8fbf07ff82c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:23.079545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6553f27-7cab-4c42-9b8d-8fbf07ff82c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.079830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6553f27-7cab-4c42-9b8d-8fbf07ff82c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.080164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6553f27-7cab-4c42-9b8d-8fbf07ff82c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.080875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6553f27-7cab-4c42-9b8d-8fbf07ff82c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:23.083173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6553f27-7cab-4c42-9b8d-8fbf07ff82c6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:23.117371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe8a1-9659-477d-9dfe-4eab4a701ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:23.120432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe8a1-9659-477d-9dfe-4eab4a701ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.121067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe8a1-9659-477d-9dfe-4eab4a701ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.121599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe8a1-9659-477d-9dfe-4eab4a701ac5 admin admin] PATH_INFO: `/v3/projects/c1c3806ba0f04e11aa247c7459a7f865/users/bda6b923d5d049f793d30f7c9791a2cd/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.124691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 886/1801] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:22 2022] POST /identity/v3/users => generated 284 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:23.126222 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d5c55-0e19-479a-ba91-1974a7e8ddfc None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.126518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d5c55-0e19-479a-ba91-1974a7e8ddfc None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.126844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d5c55-0e19-479a-ba91-1974a7e8ddfc None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.129207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 887/1802] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:27:23.129850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d5c55-0e19-479a-ba91-1974a7e8ddfc None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:23.154191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d5c55-0e19-479a-ba91-1974a7e8ddfc None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:23.159178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867fcbd-a54f-4462-b3bd-0e9752a4bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:23.159994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867fcbd-a54f-4462-b3bd-0e9752a4bc5d admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.160124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867fcbd-a54f-4462-b3bd-0e9752a4bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.160336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867fcbd-a54f-4462-b3bd-0e9752a4bc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.161062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867fcbd-a54f-4462-b3bd-0e9752a4bc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:23.162645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867fcbd-a54f-4462-b3bd-0e9752a4bc5d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:23.170362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fe8a1-9659-477d-9dfe-4eab4a701ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c3806ba0f04e11aa247c7459a7f865, user_id=bda6b923d5d049f793d30f7c9791a2cd, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:23.175235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fe8a1-9659-477d-9dfe-4eab4a701ac5 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:23.178212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 888/1803] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:23.179592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5f67-8428-4264-8b72-6f85b49e2f18 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.179909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5f67-8428-4264-8b72-6f85b49e2f18 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.180153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5f67-8428-4264-8b72-6f85b49e2f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.218864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-856a5f67-8428-4264-8b72-6f85b49e2f18 None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:23.220144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-856a5f67-8428-4264-8b72-6f85b49e2f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:23.280579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 916/1804] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:22 2022] PUT /identity/v3/projects/c1c3806ba0f04e11aa247c7459a7f865/users/bda6b923d5d049f793d30f7c9791a2cd/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:23.281608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe8a1-9659-477d-9dfe-4eab4a701ac5 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:23.391096 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:23.433131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 889/1805] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:23.435782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee65b-0905-4288-8411-d06c4507461f None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.436067 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee65b-0905-4288-8411-d06c4507461f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.436339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee65b-0905-4288-8411-d06c4507461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.453726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe8a1-9659-477d-9dfe-4eab4a701ac5 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:23.460634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8380a8-5809-4f09-8504-c7750b5cd7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:23.461333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8380a8-5809-4f09-8504-c7750b5cd7de admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.461748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8380a8-5809-4f09-8504-c7750b5cd7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.462060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8380a8-5809-4f09-8504-c7750b5cd7de admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.462934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8380a8-5809-4f09-8504-c7750b5cd7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:23.466236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8380a8-5809-4f09-8504-c7750b5cd7de admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:23.482382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 917/1806] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:23.484083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19446781-3d9a-49cf-bede-66014076d66f None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.484373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19446781-3d9a-49cf-bede-66014076d66f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.484695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19446781-3d9a-49cf-bede-66014076d66f None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.486412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 918/1807] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:27:23.487866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19446781-3d9a-49cf-bede-66014076d66f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:23.490343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e5fee65b-0905-4288-8411-d06c4507461f None None] MFA Rules not processed for user `bda6b923d5d049f793d30f7c9791a2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:23.491793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e5fee65b-0905-4288-8411-d06c4507461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:23.504845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19446781-3d9a-49cf-bede-66014076d66f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:23.510443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c84e7-409f-4b81-aa94-f235590d8c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:23.511328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c84e7-409f-4b81-aa94-f235590d8c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.512103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c84e7-409f-4b81-aa94-f235590d8c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.512398 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c84e7-409f-4b81-aa94-f235590d8c67 admin admin] PATH_INFO: `/v3/projects/3e6552d9d3b746f0a2896f704e253518/users/2ceba12729fb4779a8bd9715544f2899/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.554920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c84e7-409f-4b81-aa94-f235590d8c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6552d9d3b746f0a2896f704e253518, user_id=2ceba12729fb4779a8bd9715544f2899, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:23.557920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c84e7-409f-4b81-aa94-f235590d8c67 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:23.576028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 919/1808] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:23 2022] PUT /identity/v3/projects/3e6552d9d3b746f0a2896f704e253518/users/2ceba12729fb4779a8bd9715544f2899/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:23.577796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140a7ed-ae2e-4c61-a2b2-68bece626ddd None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.578080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140a7ed-ae2e-4c61-a2b2-68bece626ddd None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.578404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140a7ed-ae2e-4c61-a2b2-68bece626ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.602180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-a140a7ed-ae2e-4c61-a2b2-68bece626ddd None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:23.604128 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a140a7ed-ae2e-4c61-a2b2-68bece626ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:23.648436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 890/1809] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:23.648436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81851daf-4cf4-4de7-924c-985a6e4502dd None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.648436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81851daf-4cf4-4de7-924c-985a6e4502dd None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.648436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81851daf-4cf4-4de7-924c-985a6e4502dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.675903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:23.714543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-81851daf-4cf4-4de7-924c-985a6e4502dd None None] MFA Rules not processed for user `2ceba12729fb4779a8bd9715544f2899`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:23.715762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-81851daf-4cf4-4de7-924c-985a6e4502dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:23.720245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 920/1810] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:23.721524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140a7ed-ae2e-4c61-a2b2-68bece626ddd None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:23.723166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a140a7ed-ae2e-4c61-a2b2-68bece626ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:23.751196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140a7ed-ae2e-4c61-a2b2-68bece626ddd None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:23.773819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd79e8-87e3-477a-9279-dd70af135c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:23.774747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd79e8-87e3-477a-9279-dd70af135c65 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.775878 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd79e8-87e3-477a-9279-dd70af135c65 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.776367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd79e8-87e3-477a-9279-dd70af135c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.790464 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd79e8-87e3-477a-9279-dd70af135c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:23.793719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd79e8-87e3-477a-9279-dd70af135c65 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:23.810103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 921/1811] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:23.818102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd79e8-87e3-477a-9279-dd70af135c65 service nova] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:23.819572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d4fd79e8-87e3-477a-9279-dd70af135c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:23.822147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 891/1812] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:23.823461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81851daf-4cf4-4de7-924c-985a6e4502dd None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:23.825029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-81851daf-4cf4-4de7-924c-985a6e4502dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:23.921697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd79e8-87e3-477a-9279-dd70af135c65 service nova] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:23.926290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9e488-4b80-48b6-9732-b888bad40dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:23.926469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81851daf-4cf4-4de7-924c-985a6e4502dd None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:23.926974 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9e488-4b80-48b6-9732-b888bad40dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.927435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9e488-4b80-48b6-9732-b888bad40dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.927805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9e488-4b80-48b6-9732-b888bad40dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.931879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:23.932455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:23.932784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:23.933056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] PATH_INFO: `/v3/projects/ad14e343a3604412a4c95a734181f489` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:23.934240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad14e343a3604412a4c95a734181f489)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:23.936327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:23.953919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:23.994585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad14e343a3604412a4c95a734181f489', 'request_id': 'req-9dc9f200-466f-425b-a3fa-64388e458ad7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:24.001732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad14e343a3604412a4c95a734181f489', 'request_id': 'req-9dc9f200-466f-425b-a3fa-64388e458ad7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:24.007717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9e488-4b80-48b6-9732-b888bad40dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.009485 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9e488-4b80-48b6-9732-b888bad40dc2 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.013045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad14e343a3604412a4c95a734181f489', 'request_id': 'req-9dc9f200-466f-425b-a3fa-64388e458ad7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:24.023159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 922/1813] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:24.023863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9e488-4b80-48b6-9732-b888bad40dc2 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.028106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] The token cache is being invalidate because project ad14e343a3604412a4c95a734181f489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:24.028510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:24.029286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:24.031848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 892/1814] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:23 2022] DELETE /identity/v3/projects/ad14e343a3604412a4c95a734181f489 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:24.032839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.034254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:24.037475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9e488-4b80-48b6-9732-b888bad40dc2 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.152537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162f3e-9de2-40c9-a12c-34ba37258515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.154375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162f3e-9de2-40c9-a12c-34ba37258515 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.154886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162f3e-9de2-40c9-a12c-34ba37258515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.155494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162f3e-9de2-40c9-a12c-34ba37258515 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.156745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162f3e-9de2-40c9-a12c-34ba37258515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.160563 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162f3e-9de2-40c9-a12c-34ba37258515 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.181575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9f200-466f-425b-a3fa-64388e458ad7 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.190957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc632f-0ffa-4111-afc9-28a671eb23de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.191572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc632f-0ffa-4111-afc9-28a671eb23de service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.191860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc632f-0ffa-4111-afc9-28a671eb23de service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.192134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc632f-0ffa-4111-afc9-28a671eb23de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.194397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a0dc632f-0ffa-4111-afc9-28a671eb23de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:24.214054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 923/1815] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:24 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:24.214334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc632f-0ffa-4111-afc9-28a671eb23de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.215406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93354403-4439-402a-a4e7-06e2aa2e7908 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.215658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93354403-4439-402a-a4e7-06e2aa2e7908 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.215903 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc632f-0ffa-4111-afc9-28a671eb23de service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.216002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93354403-4439-402a-a4e7-06e2aa2e7908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.247384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 893/1816] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:24.248501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc632f-0ffa-4111-afc9-28a671eb23de service nova] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.251242 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a0dc632f-0ffa-4111-afc9-28a671eb23de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:24.264240 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-93354403-4439-402a-a4e7-06e2aa2e7908 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:24.266050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-93354403-4439-402a-a4e7-06e2aa2e7908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:24.274148 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:24.287178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc632f-0ffa-4111-afc9-28a671eb23de service nova] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.394154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 924/1817] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:24.403902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3d7bf-87e2-4be7-9c7e-f07ce93dddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.405063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d7bf-87e2-4be7-9c7e-f07ce93dddad admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.405189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d7bf-87e2-4be7-9c7e-f07ce93dddad admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.405663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d7bf-87e2-4be7-9c7e-f07ce93dddad admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.406555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3d7bf-87e2-4be7-9c7e-f07ce93dddad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.408041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9372-a616-448b-9921-0e825679c017 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.408328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9372-a616-448b-9921-0e825679c017 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.408628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9372-a616-448b-9921-0e825679c017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.408890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3d7bf-87e2-4be7-9c7e-f07ce93dddad admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.432629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-2f3d9372-a616-448b-9921-0e825679c017 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:24.434346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2f3d9372-a616-448b-9921-0e825679c017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:24.443755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 894/1818] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:24 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:24.445101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3d7bf-87e2-4be7-9c7e-f07ce93dddad admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.459943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3d7bf-87e2-4be7-9c7e-f07ce93dddad admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.468716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3901-4760-4470-986e-e3f69992d6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.469605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3901-4760-4470-986e-e3f69992d6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.469756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 925/1819] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:24.469907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3901-4760-4470-986e-e3f69992d6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.470194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3901-4760-4470-986e-e3f69992d6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.471061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe3901-4760-4470-986e-e3f69992d6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.474000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe3901-4760-4470-986e-e3f69992d6e7 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.481547 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d9372-a616-448b-9921-0e825679c017 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.486973 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 895/1820] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:24.490939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3901-4760-4470-986e-e3f69992d6e7 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.495525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d9372-a616-448b-9921-0e825679c017 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.504634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3901-4760-4470-986e-e3f69992d6e7 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.515901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf415a3-740f-48be-963b-cabc629d1d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.516051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8732-eb12-4acb-b9b5-888b4c6bac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.516571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf415a3-740f-48be-963b-cabc629d1d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.516849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf415a3-740f-48be-963b-cabc629d1d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.517118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf415a3-740f-48be-963b-cabc629d1d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.517220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8732-eb12-4acb-b9b5-888b4c6bac9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.517769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf415a3-740f-48be-963b-cabc629d1d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:24.517976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8732-eb12-4acb-b9b5-888b4c6bac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.518083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf415a3-740f-48be-963b-cabc629d1d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.519105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8732-eb12-4acb-b9b5-888b4c6bac9b admin admin] PATH_INFO: `/v3/projects/4740535b57e0477ba1374004fd561ff5/users/3f31157190334c558328b283a2fc57f8/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.519665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf415a3-740f-48be-963b-cabc629d1d09 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.521977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:24.541820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed8732-eb12-4acb-b9b5-888b4c6bac9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4740535b57e0477ba1374004fd561ff5, user_id=3f31157190334c558328b283a2fc57f8, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.544768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed8732-eb12-4acb-b9b5-888b4c6bac9b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.547419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 926/1821] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:27:24.552010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf415a3-740f-48be-963b-cabc629d1d09 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.564415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf415a3-740f-48be-963b-cabc629d1d09 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.566039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 896/1822] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:24 2022] PUT /identity/v3/projects/4740535b57e0477ba1374004fd561ff5/users/3f31157190334c558328b283a2fc57f8/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:24.569823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8732-eb12-4acb-b9b5-888b4c6bac9b admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.630651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba610260-0ebc-42fd-af99-904ff1e1a9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.631370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba610260-0ebc-42fd-af99-904ff1e1a9df admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.631583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba610260-0ebc-42fd-af99-904ff1e1a9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.631855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba610260-0ebc-42fd-af99-904ff1e1a9df admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.632498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba610260-0ebc-42fd-af99-904ff1e1a9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.634613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba610260-0ebc-42fd-af99-904ff1e1a9df admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.635931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8732-eb12-4acb-b9b5-888b4c6bac9b admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.640923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed12f-574e-4357-aca1-2448162b28a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.641521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed12f-574e-4357-aca1-2448162b28a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.641793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed12f-574e-4357-aca1-2448162b28a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.642057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed12f-574e-4357-aca1-2448162b28a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.642692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ed12f-574e-4357-aca1-2448162b28a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.644289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ed12f-574e-4357-aca1-2448162b28a2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.655084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 897/1823] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:24.659442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed12f-574e-4357-aca1-2448162b28a2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.664425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 927/1824] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:24 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:24.668409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba610260-0ebc-42fd-af99-904ff1e1a9df admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.669988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed12f-574e-4357-aca1-2448162b28a2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.731123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0a374-ee3c-4be5-90f6-f33d54b32aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.731957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a374-ee3c-4be5-90f6-f33d54b32aed admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.732302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a374-ee3c-4be5-90f6-f33d54b32aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.732601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a374-ee3c-4be5-90f6-f33d54b32aed admin admin] PATH_INFO: `/v3/projects/4740535b57e0477ba1374004fd561ff5/users/3f31157190334c558328b283a2fc57f8/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.735407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0a374-ee3c-4be5-90f6-f33d54b32aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4740535b57e0477ba1374004fd561ff5, user_id=3f31157190334c558328b283a2fc57f8, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.737105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba610260-0ebc-42fd-af99-904ff1e1a9df admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.738341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0a374-ee3c-4be5-90f6-f33d54b32aed admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.742636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6a548-b280-4ba5-9f1e-7b95e98ab40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.743319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6a548-b280-4ba5-9f1e-7b95e98ab40e admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.743941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6a548-b280-4ba5-9f1e-7b95e98ab40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.743941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6a548-b280-4ba5-9f1e-7b95e98ab40e admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.744536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6a548-b280-4ba5-9f1e-7b95e98ab40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.746501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6a548-b280-4ba5-9f1e-7b95e98ab40e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.752890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 898/1825] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:24 2022] PUT /identity/v3/projects/4740535b57e0477ba1374004fd561ff5/users/3f31157190334c558328b283a2fc57f8/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:24.764281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a46b4-7dc1-4048-a47b-669c19599575 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.765017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a46b4-7dc1-4048-a47b-669c19599575 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.765323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a46b4-7dc1-4048-a47b-669c19599575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.779086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 928/1826] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:24 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:24.780194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6a548-b280-4ba5-9f1e-7b95e98ab40e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.786967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:24.791871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6a548-b280-4ba5-9f1e-7b95e98ab40e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.806348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-433a46b4-7dc1-4048-a47b-669c19599575 None None] MFA Rules not processed for user `3f31157190334c558328b283a2fc57f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:24.807673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-433a46b4-7dc1-4048-a47b-669c19599575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:24.868368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987e859-6e9a-43d1-a9b9-716a1363a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.869233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e859-6e9a-43d1-a9b9-716a1363a61f admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.869343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e859-6e9a-43d1-a9b9-716a1363a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.869568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e859-6e9a-43d1-a9b9-716a1363a61f admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.870247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987e859-6e9a-43d1-a9b9-716a1363a61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.871853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987e859-6e9a-43d1-a9b9-716a1363a61f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.882725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 929/1827] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:24.887350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987e859-6e9a-43d1-a9b9-716a1363a61f admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.898235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987e859-6e9a-43d1-a9b9-716a1363a61f admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.903379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec36bd-9536-4de9-b856-324938d11b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.904158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec36bd-9536-4de9-b856-324938d11b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.904538 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec36bd-9536-4de9-b856-324938d11b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.904882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec36bd-9536-4de9-b856-324938d11b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.905011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:24.905634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec36bd-9536-4de9-b856-324938d11b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.907450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec36bd-9536-4de9-b856-324938d11b6b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.911179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 899/1828] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:24.922370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 930/1829] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:24.923054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a46b4-7dc1-4048-a47b-669c19599575 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.923338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec36bd-9536-4de9-b856-324938d11b6b admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:24.925133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9bec36bd-9536-4de9-b856-324938d11b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:24.933637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a46b4-7dc1-4048-a47b-669c19599575 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:24.939742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d357806-e45a-4bec-82aa-3728268b2bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:24.940482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d357806-e45a-4bec-82aa-3728268b2bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.940738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d357806-e45a-4bec-82aa-3728268b2bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.941010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d357806-e45a-4bec-82aa-3728268b2bbc admin admin] PATH_INFO: `/v3/projects/71fabb8c87194fa39b5d2ecdc65dbac3/users/dc68c3c441c34f3fa06a4b2915d25b09/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.959216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d357806-e45a-4bec-82aa-3728268b2bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fabb8c87194fa39b5d2ecdc65dbac3, user_id=dc68c3c441c34f3fa06a4b2915d25b09, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:24.962723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d357806-e45a-4bec-82aa-3728268b2bbc admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:24.978710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 900/1830] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:24 2022] PUT /identity/v3/projects/71fabb8c87194fa39b5d2ecdc65dbac3/users/dc68c3c441c34f3fa06a4b2915d25b09/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:24.989939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c44a-68b9-43d6-9f1a-8623ceab300d None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:24.990221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c44a-68b9-43d6-9f1a-8623ceab300d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:24.990488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c44a-68b9-43d6-9f1a-8623ceab300d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:24.993928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec36bd-9536-4de9-b856-324938d11b6b admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.019248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-0af8c44a-68b9-43d6-9f1a-8623ceab300d None None] MFA Rules not processed for user `dc68c3c441c34f3fa06a4b2915d25b09`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:25.020589 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0af8c44a-68b9-43d6-9f1a-8623ceab300d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:25.045776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66079c-5e1a-4402-b2d6-c822fe50b02b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.046393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66079c-5e1a-4402-b2d6-c822fe50b02b service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.046669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66079c-5e1a-4402-b2d6-c822fe50b02b service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.046939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66079c-5e1a-4402-b2d6-c822fe50b02b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.092685 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 901/1831] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:25.098760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8c44a-68b9-43d6-9f1a-8623ceab300d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:25.119481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:25.122605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66079c-5e1a-4402-b2d6-c822fe50b02b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:25.124854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66079c-5e1a-4402-b2d6-c822fe50b02b service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:25.135293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 931/1832] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:27:25.163734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8c44a-68b9-43d6-9f1a-8623ceab300d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.168600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9ebc-cef8-417d-a65d-79ba278a0d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.169229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9ebc-cef8-417d-a65d-79ba278a0d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.169485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9ebc-cef8-417d-a65d-79ba278a0d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.169765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9ebc-cef8-417d-a65d-79ba278a0d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.170384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc9ebc-cef8-417d-a65d-79ba278a0d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:25.172283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc9ebc-cef8-417d-a65d-79ba278a0d5a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:25.206679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 902/1833] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:25 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:25.210571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66079c-5e1a-4402-b2d6-c822fe50b02b service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:25.225722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66079c-5e1a-4402-b2d6-c822fe50b02b service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.226530 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9ebc-cef8-417d-a65d-79ba278a0d5a admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:25.283306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:25.287247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9ebc-cef8-417d-a65d-79ba278a0d5a admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.292128 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa789290-b079-435b-bced-b8cfb1685ff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.292920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa789290-b079-435b-bced-b8cfb1685ff1 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.293427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa789290-b079-435b-bced-b8cfb1685ff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.293825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa789290-b079-435b-bced-b8cfb1685ff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.296091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-aa789290-b079-435b-bced-b8cfb1685ff1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:25.297164 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35c2f8-d1f9-4984-b1bf-8d8f214103ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.298312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c2f8-d1f9-4984-b1bf-8d8f214103ed admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.298694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c2f8-d1f9-4984-b1bf-8d8f214103ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.299502 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c2f8-d1f9-4984-b1bf-8d8f214103ed admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.300158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35c2f8-d1f9-4984-b1bf-8d8f214103ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:25.302243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35c2f8-d1f9-4984-b1bf-8d8f214103ed admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:25.345446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 932/1834] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:25 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:25.346565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35c2f8-d1f9-4984-b1bf-8d8f214103ed admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:25.375313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35c2f8-d1f9-4984-b1bf-8d8f214103ed admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.377119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa789290-b079-435b-bced-b8cfb1685ff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:25.378560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa789290-b079-435b-bced-b8cfb1685ff1 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:25.388418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c00783-dc77-40f4-9436-70b1d43ab977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.388418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c00783-dc77-40f4-9436-70b1d43ab977 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.388731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 903/1835] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:27:25.388811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c00783-dc77-40f4-9436-70b1d43ab977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.388811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c00783-dc77-40f4-9436-70b1d43ab977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.389152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c00783-dc77-40f4-9436-70b1d43ab977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:25.391772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c00783-dc77-40f4-9436-70b1d43ab977 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:25.404416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 933/1836] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:25.407008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa789290-b079-435b-bced-b8cfb1685ff1 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:25.418468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa789290-b079-435b-bced-b8cfb1685ff1 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.423101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22948eb-5392-4066-807a-58f358d3fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.423748 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22948eb-5392-4066-807a-58f358d3fcbd admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.424026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22948eb-5392-4066-807a-58f358d3fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.424291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22948eb-5392-4066-807a-58f358d3fcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.424969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22948eb-5392-4066-807a-58f358d3fcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:25.426558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22948eb-5392-4066-807a-58f358d3fcbd admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:25.437286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 904/1837] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:25.442179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c00783-dc77-40f4-9436-70b1d43ab977 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:25.452589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c00783-dc77-40f4-9436-70b1d43ab977 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.457229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c3c75-f1bc-4cfc-8eb1-cfe01ff93858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.457884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c3c75-f1bc-4cfc-8eb1-cfe01ff93858 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.458163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c3c75-f1bc-4cfc-8eb1-cfe01ff93858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.458437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c3c75-f1bc-4cfc-8eb1-cfe01ff93858 admin admin] PATH_INFO: `/v3/projects/a249cc3da821467fae16fa41eb328d44/users/6204441e0ce842fdba4e07e6a3f30e92/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.475586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c3c75-f1bc-4cfc-8eb1-cfe01ff93858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a249cc3da821467fae16fa41eb328d44, user_id=6204441e0ce842fdba4e07e6a3f30e92, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:25.479049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c3c75-f1bc-4cfc-8eb1-cfe01ff93858 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:25.493937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 934/1838] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:25 2022] PUT /identity/v3/projects/a249cc3da821467fae16fa41eb328d44/users/6204441e0ce842fdba4e07e6a3f30e92/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:25.504411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e94f-6151-4269-a2d0-1e25c70798cd None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.504701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e94f-6151-4269-a2d0-1e25c70798cd None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.504973 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e94f-6151-4269-a2d0-1e25c70798cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.550369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-09b1e94f-6151-4269-a2d0-1e25c70798cd None None] MFA Rules not processed for user `6204441e0ce842fdba4e07e6a3f30e92`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:25.551754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-09b1e94f-6151-4269-a2d0-1e25c70798cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:25.636497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 905/1839] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:25.639249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c3c75-f1bc-4cfc-8eb1-cfe01ff93858 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:25.719291 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c3c75-f1bc-4cfc-8eb1-cfe01ff93858 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.738769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5fcb2-a3be-4a27-b3b2-46987a2a7cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.739501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5fcb2-a3be-4a27-b3b2-46987a2a7cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.739895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5fcb2-a3be-4a27-b3b2-46987a2a7cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.740310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5fcb2-a3be-4a27-b3b2-46987a2a7cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.741028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5fcb2-a3be-4a27-b3b2-46987a2a7cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:25.742994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5fcb2-a3be-4a27-b3b2-46987a2a7cd6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:25.775572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 935/1840] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:25 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:25.779937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e94f-6151-4269-a2d0-1e25c70798cd None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:25.791095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e94f-6151-4269-a2d0-1e25c70798cd None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.848169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56acf7-eae3-4f2b-8a70-c63103b1c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.848808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56acf7-eae3-4f2b-8a70-c63103b1c384 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.849091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56acf7-eae3-4f2b-8a70-c63103b1c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.849364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56acf7-eae3-4f2b-8a70-c63103b1c384 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.849997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56acf7-eae3-4f2b-8a70-c63103b1c384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:25.852084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56acf7-eae3-4f2b-8a70-c63103b1c384 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:25.874678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 906/1841] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:25 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:25.878735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5fcb2-a3be-4a27-b3b2-46987a2a7cd6 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:25.908679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5fcb2-a3be-4a27-b3b2-46987a2a7cd6 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.925645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607658-901f-47c0-8a7b-c70fd220d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.928802 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607658-901f-47c0-8a7b-c70fd220d546 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.929086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607658-901f-47c0-8a7b-c70fd220d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.929358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607658-901f-47c0-8a7b-c70fd220d546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.930037 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607658-901f-47c0-8a7b-c70fd220d546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:25.931871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607658-901f-47c0-8a7b-c70fd220d546 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:25.955385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 936/1842] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:25.959677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56acf7-eae3-4f2b-8a70-c63103b1c384 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:25.975781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56acf7-eae3-4f2b-8a70-c63103b1c384 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:25.981577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d9eb6-c5a9-4e5f-8fbb-f24f9d01eaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:25.982325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d9eb6-c5a9-4e5f-8fbb-f24f9d01eaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:25.982894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d9eb6-c5a9-4e5f-8fbb-f24f9d01eaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:25.983228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d9eb6-c5a9-4e5f-8fbb-f24f9d01eaa3 admin admin] PATH_INFO: `/v3/projects/0722cbf18551435c912b0a34bb321eb2/users/354340241cf540e696fb3c7713a7e463/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:25.997654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:26.007709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d9eb6-c5a9-4e5f-8fbb-f24f9d01eaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0722cbf18551435c912b0a34bb321eb2, user_id=354340241cf540e696fb3c7713a7e463, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:26.011225 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d9eb6-c5a9-4e5f-8fbb-f24f9d01eaa3 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:26.040258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 907/1843] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:25 2022] PUT /identity/v3/projects/0722cbf18551435c912b0a34bb321eb2/users/354340241cf540e696fb3c7713a7e463/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:26.041829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607658-901f-47c0-8a7b-c70fd220d546 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:26.055808 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607658-901f-47c0-8a7b-c70fd220d546 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:26.116883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:26.178379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea0d75-bd3e-48a9-a483-b0168ae5fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:26.179011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea0d75-bd3e-48a9-a483-b0168ae5fb21 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:26.179288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea0d75-bd3e-48a9-a483-b0168ae5fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:26.179560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea0d75-bd3e-48a9-a483-b0168ae5fb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:26.180241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea0d75-bd3e-48a9-a483-b0168ae5fb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:26.183386 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea0d75-bd3e-48a9-a483-b0168ae5fb21 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:26.194558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 937/1844] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:26.199916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d9eb6-c5a9-4e5f-8fbb-f24f9d01eaa3 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:26.211060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d9eb6-c5a9-4e5f-8fbb-f24f9d01eaa3 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:26.219648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709cf4-fde6-4106-8833-2fc337177bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:26.220344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709cf4-fde6-4106-8833-2fc337177bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:26.220757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709cf4-fde6-4106-8833-2fc337177bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:26.221037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709cf4-fde6-4106-8833-2fc337177bc8 admin admin] PATH_INFO: `/v3/projects/0722cbf18551435c912b0a34bb321eb2/users/354340241cf540e696fb3c7713a7e463/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:26.223172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5709cf4-fde6-4106-8833-2fc337177bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0722cbf18551435c912b0a34bb321eb2, user_id=354340241cf540e696fb3c7713a7e463, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:26.226327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5709cf4-fde6-4106-8833-2fc337177bc8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:26.240093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 908/1845] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:26 2022] PUT /identity/v3/projects/0722cbf18551435c912b0a34bb321eb2/users/354340241cf540e696fb3c7713a7e463/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:26.252350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6532-259a-4fca-b09c-dcf32ab8f940 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:26.252661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6532-259a-4fca-b09c-dcf32ab8f940 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:26.252936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6532-259a-4fca-b09c-dcf32ab8f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:26.289187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f22f6532-259a-4fca-b09c-dcf32ab8f940 None None] MFA Rules not processed for user `354340241cf540e696fb3c7713a7e463`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:26.290851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f22f6532-259a-4fca-b09c-dcf32ab8f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:26.373143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 938/1846] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:26.386659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709cf4-fde6-4106-8833-2fc337177bc8 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:26.517717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709cf4-fde6-4106-8833-2fc337177bc8 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:26.521839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065244a2-8fd2-44c9-8067-cdb8517d35ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:26.522553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065244a2-8fd2-44c9-8067-cdb8517d35ee service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:26.522978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065244a2-8fd2-44c9-8067-cdb8517d35ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:26.523255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065244a2-8fd2-44c9-8067-cdb8517d35ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:26.534745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065244a2-8fd2-44c9-8067-cdb8517d35ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:26.536761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065244a2-8fd2-44c9-8067-cdb8517d35ee service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:26.547895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 909/1847] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:27.241853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6532-259a-4fca-b09c-dcf32ab8f940 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:27.251734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6532-259a-4fca-b09c-dcf32ab8f940 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:27.255482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdd936-de30-4cc8-b05c-b929841c7457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:27.256089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdd936-de30-4cc8-b05c-b929841c7457 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:27.256361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdd936-de30-4cc8-b05c-b929841c7457 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:27.256672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdd936-de30-4cc8-b05c-b929841c7457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:27.315416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdd936-de30-4cc8-b05c-b929841c7457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:27.316952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdd936-de30-4cc8-b05c-b929841c7457 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:27.326880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 939/1848] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:35.824100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065244a2-8fd2-44c9-8067-cdb8517d35ee service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:35.898179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065244a2-8fd2-44c9-8067-cdb8517d35ee service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:35.903734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:35.904680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.905053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.906102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] PATH_INFO: `/v3/users/2ceba12729fb4779a8bd9715544f2899` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.907571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ceba12729fb4779a8bd9715544f2899)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:35.909642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:35.988309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ceba12729fb4779a8bd9715544f2899'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:35.989231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ceba12729fb4779a8bd9715544f2899'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:35.997682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ceba12729fb4779a8bd9715544f2899'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.013429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ceba12729fb4779a8bd9715544f2899'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.014649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ceba12729fb4779a8bd9715544f2899'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.021520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:36.041683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 910/1849] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:35 2022] DELETE /identity/v3/users/2ceba12729fb4779a8bd9715544f2899 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:36.043887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802e6d1-037a-41b9-aa25-8cb5eee658f8 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:36.044874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802e6d1-037a-41b9-aa25-8cb5eee658f8 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:36.045390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802e6d1-037a-41b9-aa25-8cb5eee658f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:36.069991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f802e6d1-037a-41b9-aa25-8cb5eee658f8 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:36.071517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f802e6d1-037a-41b9-aa25-8cb5eee658f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:36.130961 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:36.170559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 940/1850] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:36.179065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:36.181075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:36.252343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97837d-2320-4762-b124-3ad46e0557f4 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:36.256431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49963e-b200-4ba7-a51d-801a755709a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:36.257061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49963e-b200-4ba7-a51d-801a755709a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:36.257344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49963e-b200-4ba7-a51d-801a755709a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:36.257620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49963e-b200-4ba7-a51d-801a755709a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:36.273674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49963e-b200-4ba7-a51d-801a755709a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:36.275369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49963e-b200-4ba7-a51d-801a755709a5 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:36.295123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 911/1851] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:27:36.316946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802e6d1-037a-41b9-aa25-8cb5eee658f8 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:36.318580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f802e6d1-037a-41b9-aa25-8cb5eee658f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:36.333266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802e6d1-037a-41b9-aa25-8cb5eee658f8 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:36.339121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:36.339954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:36.340540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:36.341105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] PATH_INFO: `/v3/users/7a2423a1a144418ea2fb5e447c4a28aa` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:36.342460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2423a1a144418ea2fb5e447c4a28aa)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:36.345260 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:36.438167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2423a1a144418ea2fb5e447c4a28aa'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.438996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2423a1a144418ea2fb5e447c4a28aa'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.439674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2423a1a144418ea2fb5e447c4a28aa'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.453244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2423a1a144418ea2fb5e447c4a28aa'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.468116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2423a1a144418ea2fb5e447c4a28aa'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.487777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 941/1852] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:36 2022] DELETE /identity/v3/users/7a2423a1a144418ea2fb5e447c4a28aa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:36.492141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8f166-6c2c-4901-8980-56ac6f7cc80c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:36.492458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8f166-6c2c-4901-8980-56ac6f7cc80c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:36.492740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8f166-6c2c-4901-8980-56ac6f7cc80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:36.514074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6ba8f166-6c2c-4901-8980-56ac6f7cc80c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:36.515539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6ba8f166-6c2c-4901-8980-56ac6f7cc80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:36.587802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 912/1853] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:36.597902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:36.599932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:36.662737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6905c-500b-4f55-8609-3880d0932575 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:36.667197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bff79-4527-4430-a2a6-f4fdc878e743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:36.668365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bff79-4527-4430-a2a6-f4fdc878e743 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:36.668859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bff79-4527-4430-a2a6-f4fdc878e743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:36.669131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bff79-4527-4430-a2a6-f4fdc878e743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:36.678698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bff79-4527-4430-a2a6-f4fdc878e743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:36.680147 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bff79-4527-4430-a2a6-f4fdc878e743 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:36.689997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 942/1854] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:36.861254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8f166-6c2c-4901-8980-56ac6f7cc80c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:36.862945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6ba8f166-6c2c-4901-8980-56ac6f7cc80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:36.887446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8f166-6c2c-4901-8980-56ac6f7cc80c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:36.893328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:36.893986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:36.894261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:36.894684 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] PATH_INFO: `/v3/projects/3e6552d9d3b746f0a2896f704e253518` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:36.895953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6552d9d3b746f0a2896f704e253518)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:36.898015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:36.961755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6552d9d3b746f0a2896f704e253518', 'request_id': 'req-8f5b9e75-5514-402b-a360-003ebe3fd7b8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.969181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6552d9d3b746f0a2896f704e253518', 'request_id': 'req-8f5b9e75-5514-402b-a360-003ebe3fd7b8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.983199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6552d9d3b746f0a2896f704e253518', 'request_id': 'req-8f5b9e75-5514-402b-a360-003ebe3fd7b8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.996205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] The token cache is being invalidate because project 3e6552d9d3b746f0a2896f704e253518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:36.996550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:36.997189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.000501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 913/1855] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:36 2022] DELETE /identity/v3/projects/3e6552d9d3b746f0a2896f704e253518 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:37.003180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bff79-4527-4430-a2a6-f4fdc878e743 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:37.013435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bff79-4527-4430-a2a6-f4fdc878e743 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:37.046212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:37.047701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:37.101609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:37.112730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:37.113498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:37.113844 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:37.114284 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] PATH_INFO: `/v3/users/3f31157190334c558328b283a2fc57f8` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:37.117398 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f31157190334c558328b283a2fc57f8)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:37.119930 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:37.121836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:37.176343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b9e75-5514-402b-a360-003ebe3fd7b8 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:37.186820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:37.187613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:37.187905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:37.188516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] PATH_INFO: `/v3/projects/3a283a5fbc884c5d9fdd1acfb11392b0` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:37.190496 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a283a5fbc884c5d9fdd1acfb11392b0)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:37.193202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:37.197139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f31157190334c558328b283a2fc57f8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.198281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f31157190334c558328b283a2fc57f8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.199044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f31157190334c558328b283a2fc57f8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.211468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f31157190334c558328b283a2fc57f8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.229469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f31157190334c558328b283a2fc57f8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.249329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 943/1856] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:37 2022] DELETE /identity/v3/users/3f31157190334c558328b283a2fc57f8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:37.259968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a283a5fbc884c5d9fdd1acfb11392b0', 'request_id': 'req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.267491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a283a5fbc884c5d9fdd1acfb11392b0', 'request_id': 'req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.278523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a283a5fbc884c5d9fdd1acfb11392b0', 'request_id': 'req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.294842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] The token cache is being invalidate because project 3a283a5fbc884c5d9fdd1acfb11392b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:37.295500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.296178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.298348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 914/1857] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:37 2022] DELETE /identity/v3/projects/3a283a5fbc884c5d9fdd1acfb11392b0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:37.303277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:37.304876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:37.374433 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0d0e6-84aa-46ec-aac9-1c1da5850c26 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:37.379274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:37.379919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:37.380193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:37.380506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] PATH_INFO: `/v3/users/11d9a8bbe8f74172951e0ad277f100d0` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:37.381682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d9a8bbe8f74172951e0ad277f100d0)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:37.383655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:37.445274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d9a8bbe8f74172951e0ad277f100d0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.446117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d9a8bbe8f74172951e0ad277f100d0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.447797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d9a8bbe8f74172951e0ad277f100d0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.460114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d9a8bbe8f74172951e0ad277f100d0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.479312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2344c8f1-9caf-49a8-9f9b-89ae228f7d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d9a8bbe8f74172951e0ad277f100d0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.490935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:37.500454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 944/1858] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:37 2022] DELETE /identity/v3/users/11d9a8bbe8f74172951e0ad277f100d0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:37.550418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:37.552663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:37.683457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4041cd8-fd7c-4c18-9b56-d5674ca1c2e6 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:37.788838 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:37.789503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:37.789793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:37.790068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] PATH_INFO: `/v3/projects/4740535b57e0477ba1374004fd561ff5` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:37.791584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4740535b57e0477ba1374004fd561ff5)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:37.794080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:37.795620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:37.853523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4740535b57e0477ba1374004fd561ff5', 'request_id': 'req-1515a924-570d-4917-baa3-9dacff31048c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.860250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4740535b57e0477ba1374004fd561ff5', 'request_id': 'req-1515a924-570d-4917-baa3-9dacff31048c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.869626 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4740535b57e0477ba1374004fd561ff5', 'request_id': 'req-1515a924-570d-4917-baa3-9dacff31048c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.881021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] The token cache is being invalidate because project 4740535b57e0477ba1374004fd561ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:37.881384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.882124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:37.883850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 915/1859] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:37 2022] DELETE /identity/v3/projects/4740535b57e0477ba1374004fd561ff5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:37.890568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519da7-9ea7-4267-aeeb-8cc1d5d211c0 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:37.890857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519da7-9ea7-4267-aeeb-8cc1d5d211c0 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:37.891133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519da7-9ea7-4267-aeeb-8cc1d5d211c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:37.891308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:37.892833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:37.916671 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-76519da7-9ea7-4267-aeeb-8cc1d5d211c0 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:37.918704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-76519da7-9ea7-4267-aeeb-8cc1d5d211c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:37.962014 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a924-570d-4917-baa3-9dacff31048c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:37.966908 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:37.967541 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:37.967820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:37.968092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] PATH_INFO: `/v3/projects/01d9afcfb5aa4277ac0ea8a3ac8dd649` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:37.969273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d9afcfb5aa4277ac0ea8a3ac8dd649)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:37.971497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:37.980181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 945/1860] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:37.988229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4615-8f8c-4440-8637-88de16b85d18 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:37.988698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4615-8f8c-4440-8637-88de16b85d18 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:37.989005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4615-8f8c-4440-8637-88de16b85d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.011183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-591c4615-8f8c-4440-8637-88de16b85d18 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:38.012949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-591c4615-8f8c-4440-8637-88de16b85d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:38.021679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d9afcfb5aa4277ac0ea8a3ac8dd649', 'request_id': 'req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:38.028995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d9afcfb5aa4277ac0ea8a3ac8dd649', 'request_id': 'req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:38.038380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d9afcfb5aa4277ac0ea8a3ac8dd649', 'request_id': 'req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:38.050085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] The token cache is being invalidate because project 01d9afcfb5aa4277ac0ea8a3ac8dd649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:38.050370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:38.051024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b2225e31-d4a7-42fb-a17a-8e8c23704b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:38.053147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 916/1861] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:37 2022] DELETE /identity/v3/projects/01d9afcfb5aa4277ac0ea8a3ac8dd649 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:38.057829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e641f-f25d-47c4-8a8b-f2e61751c90e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.058061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e641f-f25d-47c4-8a8b-f2e61751c90e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.058323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e641f-f25d-47c4-8a8b-f2e61751c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.078613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-481e641f-f25d-47c4-8a8b-f2e61751c90e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:38.079625 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-481e641f-f25d-47c4-8a8b-f2e61751c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:38.080091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 946/1862] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:38.084424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4615-8f8c-4440-8637-88de16b85d18 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.089539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 917/1863] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:38.096035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4615-8f8c-4440-8637-88de16b85d18 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.098886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed445-4ada-47be-bd35-8744de19969d None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.099173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed445-4ada-47be-bd35-8744de19969d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.099445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed445-4ada-47be-bd35-8744de19969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.101953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6380a5b-8e92-4675-b3c1-af140cdddd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.102577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6380a5b-8e92-4675-b3c1-af140cdddd50 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.102843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6380a5b-8e92-4675-b3c1-af140cdddd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.103110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6380a5b-8e92-4675-b3c1-af140cdddd50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.103761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6380a5b-8e92-4675-b3c1-af140cdddd50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:38.104292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6380a5b-8e92-4675-b3c1-af140cdddd50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.105988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6380a5b-8e92-4675-b3c1-af140cdddd50 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.121563 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 947/1864] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:27:38.122189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-996ed445-4ada-47be-bd35-8744de19969d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:38.122189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-996ed445-4ada-47be-bd35-8744de19969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:38.122723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6380a5b-8e92-4675-b3c1-af140cdddd50 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.128641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 918/1865] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:38.132565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ed445-4ada-47be-bd35-8744de19969d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.132811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6380a5b-8e92-4675-b3c1-af140cdddd50 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.137570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0677e-65b1-4de2-94de-e9db0bd43cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.138192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0677e-65b1-4de2-94de-e9db0bd43cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.138812 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0677e-65b1-4de2-94de-e9db0bd43cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.139083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0677e-65b1-4de2-94de-e9db0bd43cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.139744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0677e-65b1-4de2-94de-e9db0bd43cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.141738 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0677e-65b1-4de2-94de-e9db0bd43cb2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.142162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ed445-4ada-47be-bd35-8744de19969d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.146774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10eb54-ae0f-4e1c-af35-c9fa4054d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.147358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10eb54-ae0f-4e1c-af35-c9fa4054d6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.147633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10eb54-ae0f-4e1c-af35-c9fa4054d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.147902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10eb54-ae0f-4e1c-af35-c9fa4054d6c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.148593 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10eb54-ae0f-4e1c-af35-c9fa4054d6c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:38.148894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10eb54-ae0f-4e1c-af35-c9fa4054d6c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.151095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10eb54-ae0f-4e1c-af35-c9fa4054d6c2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.153238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:38.168430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 919/1866] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:27:38.169565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10eb54-ae0f-4e1c-af35-c9fa4054d6c2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.176950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 948/1867] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:38.177948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0677e-65b1-4de2-94de-e9db0bd43cb2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.180005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10eb54-ae0f-4e1c-af35-c9fa4054d6c2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.241305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0677e-65b1-4de2-94de-e9db0bd43cb2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.244301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8324d-f190-44ba-8d15-485ec78dbf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.245089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8324d-f190-44ba-8d15-485ec78dbf9d admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.245366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8324d-f190-44ba-8d15-485ec78dbf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.245633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8324d-f190-44ba-8d15-485ec78dbf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.246274 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8324d-f190-44ba-8d15-485ec78dbf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.248231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8324d-f190-44ba-8d15-485ec78dbf9d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.251895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05db95-6a99-4743-ac68-1e5fc0e24f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.253530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05db95-6a99-4743-ac68-1e5fc0e24f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.253831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05db95-6a99-4743-ac68-1e5fc0e24f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.254106 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05db95-6a99-4743-ac68-1e5fc0e24f26 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.254758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05db95-6a99-4743-ac68-1e5fc0e24f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.256850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05db95-6a99-4743-ac68-1e5fc0e24f26 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.272326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:38.280739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 920/1868] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:38.285359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8324d-f190-44ba-8d15-485ec78dbf9d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.289211 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 949/1869] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:38.293573 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05db95-6a99-4743-ac68-1e5fc0e24f26 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.306993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05db95-6a99-4743-ac68-1e5fc0e24f26 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.364237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8324d-f190-44ba-8d15-485ec78dbf9d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.369477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27625f6-6f3f-4fa9-aa04-d7960da9cd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.370535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27625f6-6f3f-4fa9-aa04-d7960da9cd28 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.370535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27625f6-6f3f-4fa9-aa04-d7960da9cd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.370732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27625f6-6f3f-4fa9-aa04-d7960da9cd28 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.371306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27625f6-6f3f-4fa9-aa04-d7960da9cd28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.373477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27625f6-6f3f-4fa9-aa04-d7960da9cd28 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.400666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95052d68-6c8c-4392-8509-17c5057fda8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.401300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95052d68-6c8c-4392-8509-17c5057fda8d admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.401869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95052d68-6c8c-4392-8509-17c5057fda8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.402114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95052d68-6c8c-4392-8509-17c5057fda8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.402854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95052d68-6c8c-4392-8509-17c5057fda8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.404604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95052d68-6c8c-4392-8509-17c5057fda8d admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.412863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 921/1870] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/users => generated 282 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:38.421484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27625f6-6f3f-4fa9-aa04-d7960da9cd28 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.426389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 950/1871] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:38.427321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95052d68-6c8c-4392-8509-17c5057fda8d admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.434170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27625f6-6f3f-4fa9-aa04-d7960da9cd28 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.438522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95052d68-6c8c-4392-8509-17c5057fda8d admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.443633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88556bc5-017b-46be-ade0-93361d37f939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.444471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88556bc5-017b-46be-ade0-93361d37f939 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.444753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88556bc5-017b-46be-ade0-93361d37f939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.445025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88556bc5-017b-46be-ade0-93361d37f939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.445677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88556bc5-017b-46be-ade0-93361d37f939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.446001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58e85b-910f-42cd-b0fa-3dbef7e2a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.447056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58e85b-910f-42cd-b0fa-3dbef7e2a575 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.447554 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58e85b-910f-42cd-b0fa-3dbef7e2a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.447658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88556bc5-017b-46be-ade0-93361d37f939 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.448142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58e85b-910f-42cd-b0fa-3dbef7e2a575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.449268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58e85b-910f-42cd-b0fa-3dbef7e2a575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.451643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58e85b-910f-42cd-b0fa-3dbef7e2a575 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.461361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 951/1872] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:38.465761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 922/1873] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:38.469781 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88556bc5-017b-46be-ade0-93361d37f939 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.473730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58e85b-910f-42cd-b0fa-3dbef7e2a575 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.482341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88556bc5-017b-46be-ade0-93361d37f939 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.485734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58e85b-910f-42cd-b0fa-3dbef7e2a575 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.486525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f508f19-1de9-4dc2-b7b1-e2889baa799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.487218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508f19-1de9-4dc2-b7b1-e2889baa799d admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.487555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508f19-1de9-4dc2-b7b1-e2889baa799d admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.487838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508f19-1de9-4dc2-b7b1-e2889baa799d admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.488523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f508f19-1de9-4dc2-b7b1-e2889baa799d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.490209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f508f19-1de9-4dc2-b7b1-e2889baa799d admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.492355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78b59f-4775-4928-89ea-c6279327daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.493522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78b59f-4775-4928-89ea-c6279327daa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.494175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78b59f-4775-4928-89ea-c6279327daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.494629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78b59f-4775-4928-89ea-c6279327daa2 admin admin] PATH_INFO: `/v3/projects/6ba74988081f4971adb8aab5705743f3/users/b8d933a8b2a245f792cf8c63e2f09cfb/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.503832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 952/1874] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:38.505225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f508f19-1de9-4dc2-b7b1-e2889baa799d admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.515771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78b59f-4775-4928-89ea-c6279327daa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba74988081f4971adb8aab5705743f3, user_id=b8d933a8b2a245f792cf8c63e2f09cfb, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.516080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f508f19-1de9-4dc2-b7b1-e2889baa799d admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.518802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78b59f-4775-4928-89ea-c6279327daa2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.520953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c678a-b24c-4bc6-95c0-7f27cd7ee778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.521616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c678a-b24c-4bc6-95c0-7f27cd7ee778 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.521887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c678a-b24c-4bc6-95c0-7f27cd7ee778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.522390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c678a-b24c-4bc6-95c0-7f27cd7ee778 admin admin] PATH_INFO: `/v3/projects/836e4ae5988c4b1cb90f9a035fbb016b/users/fe0495f21ff94d179050c2300686c47e/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.533922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 923/1875] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:38 2022] PUT /identity/v3/projects/6ba74988081f4971adb8aab5705743f3/users/b8d933a8b2a245f792cf8c63e2f09cfb/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:38.538009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c678a-b24c-4bc6-95c0-7f27cd7ee778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836e4ae5988c4b1cb90f9a035fbb016b, user_id=fe0495f21ff94d179050c2300686c47e, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.540895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c678a-b24c-4bc6-95c0-7f27cd7ee778 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.544647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2ae13-8a5b-484a-84b8-a0939a0fb201 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.544922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2ae13-8a5b-484a-84b8-a0939a0fb201 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.545235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2ae13-8a5b-484a-84b8-a0939a0fb201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.557317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 953/1876] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:38 2022] PUT /identity/v3/projects/836e4ae5988c4b1cb90f9a035fbb016b/users/fe0495f21ff94d179050c2300686c47e/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:38.567624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f843171-659b-42a5-b2be-3e688e1c83ae None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.567835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f843171-659b-42a5-b2be-3e688e1c83ae None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.568132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f843171-659b-42a5-b2be-3e688e1c83ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.576052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-b1b2ae13-8a5b-484a-84b8-a0939a0fb201 None None] MFA Rules not processed for user `b8d933a8b2a245f792cf8c63e2f09cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:38.577311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b1b2ae13-8a5b-484a-84b8-a0939a0fb201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:38.595341 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6f843171-659b-42a5-b2be-3e688e1c83ae None None] MFA Rules not processed for user `fe0495f21ff94d179050c2300686c47e`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:38.596701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6f843171-659b-42a5-b2be-3e688e1c83ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:38.597270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:38.646525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 924/1877] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:38.651339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2ae13-8a5b-484a-84b8-a0939a0fb201 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.674609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 954/1878] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:38.675562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f843171-659b-42a5-b2be-3e688e1c83ae None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.720289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:38.733206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2ae13-8a5b-484a-84b8-a0939a0fb201 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.738705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694452ab-017b-4835-a2cc-e897ae54084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.739325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694452ab-017b-4835-a2cc-e897ae54084b admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.740781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694452ab-017b-4835-a2cc-e897ae54084b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.741062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694452ab-017b-4835-a2cc-e897ae54084b admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.741888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694452ab-017b-4835-a2cc-e897ae54084b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.744194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694452ab-017b-4835-a2cc-e897ae54084b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.761360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f843171-659b-42a5-b2be-3e688e1c83ae None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.768197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670285c-f5fe-4c9c-b3ad-c52c651cb8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.769026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670285c-f5fe-4c9c-b3ad-c52c651cb8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.769355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670285c-f5fe-4c9c-b3ad-c52c651cb8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.769632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670285c-f5fe-4c9c-b3ad-c52c651cb8a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.770280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670285c-f5fe-4c9c-b3ad-c52c651cb8a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.773323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670285c-f5fe-4c9c-b3ad-c52c651cb8a8 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.788989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 925/1879] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:38.792996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694452ab-017b-4835-a2cc-e897ae54084b admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.842968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 955/1880] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:38.847048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670285c-f5fe-4c9c-b3ad-c52c651cb8a8 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.875912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694452ab-017b-4835-a2cc-e897ae54084b admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.931168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670285c-f5fe-4c9c-b3ad-c52c651cb8a8 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.936027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a5b61-6a27-46be-a18c-53afcaa98b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.936679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a5b61-6a27-46be-a18c-53afcaa98b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.937050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a5b61-6a27-46be-a18c-53afcaa98b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.937237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a5b61-6a27-46be-a18c-53afcaa98b5b admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.937885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a5b61-6a27-46be-a18c-53afcaa98b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.939876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a5b61-6a27-46be-a18c-53afcaa98b5b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.943457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:38.951382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e7919-b121-4bc4-ac9d-f562c2f95261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.952008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e7919-b121-4bc4-ac9d-f562c2f95261 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.953213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e7919-b121-4bc4-ac9d-f562c2f95261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.953777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e7919-b121-4bc4-ac9d-f562c2f95261 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.954634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e7919-b121-4bc4-ac9d-f562c2f95261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.956639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e7919-b121-4bc4-ac9d-f562c2f95261 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.970479 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 956/1881] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:38.971327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a5b61-6a27-46be-a18c-53afcaa98b5b admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.984903 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 926/1882] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:38 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:38.988233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a5b61-6a27-46be-a18c-53afcaa98b5b admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:38.988742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e7919-b121-4bc4-ac9d-f562c2f95261 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:38.992984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5aecf-4ac9-403f-ad19-fd17bc97c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:38.993642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5aecf-4ac9-403f-ad19-fd17bc97c633 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:38.993915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5aecf-4ac9-403f-ad19-fd17bc97c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:38.994183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5aecf-4ac9-403f-ad19-fd17bc97c633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:38.994832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5aecf-4ac9-403f-ad19-fd17bc97c633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:38.996480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5aecf-4ac9-403f-ad19-fd17bc97c633 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:38.998290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e7919-b121-4bc4-ac9d-f562c2f95261 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:39.002828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96214e-eff8-42c2-9e83-aef094fb08ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:39.003421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96214e-eff8-42c2-9e83-aef094fb08ec admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.003693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96214e-eff8-42c2-9e83-aef094fb08ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.003962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96214e-eff8-42c2-9e83-aef094fb08ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.004630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96214e-eff8-42c2-9e83-aef094fb08ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:39.006203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96214e-eff8-42c2-9e83-aef094fb08ec admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:39.010489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 957/1883] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:39.011193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5aecf-4ac9-403f-ad19-fd17bc97c633 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:39.019849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 927/1884] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:39.020928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96214e-eff8-42c2-9e83-aef094fb08ec admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:39.021794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5aecf-4ac9-403f-ad19-fd17bc97c633 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:39.026903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04a86d-d2e9-40f5-9e5a-336ae858cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:39.027554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a86d-d2e9-40f5-9e5a-336ae858cd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.027833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a86d-d2e9-40f5-9e5a-336ae858cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.028218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a86d-d2e9-40f5-9e5a-336ae858cd15 admin admin] PATH_INFO: `/v3/projects/d4f30fb03c074cf095eca44bb871226c/users/f981727938224ccdbe49f1153f45e034/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.030340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96214e-eff8-42c2-9e83-aef094fb08ec admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:39.034879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18980-bbf4-4102-b460-e758b5ddd4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:39.035511 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18980-bbf4-4102-b460-e758b5ddd4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.035786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18980-bbf4-4102-b460-e758b5ddd4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.036056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18980-bbf4-4102-b460-e758b5ddd4fa admin admin] PATH_INFO: `/v3/projects/a149762bdc9441bda9f0c9b2ca3cea3d/users/ce0841e9f74e4958a205ed4e1b78bc26/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.043712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04a86d-d2e9-40f5-9e5a-336ae858cd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f30fb03c074cf095eca44bb871226c, user_id=f981727938224ccdbe49f1153f45e034, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:39.046481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04a86d-d2e9-40f5-9e5a-336ae858cd15 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:39.051117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18980-bbf4-4102-b460-e758b5ddd4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a149762bdc9441bda9f0c9b2ca3cea3d, user_id=ce0841e9f74e4958a205ed4e1b78bc26, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:39.054028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18980-bbf4-4102-b460-e758b5ddd4fa admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:39.061853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 958/1885] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:39 2022] PUT /identity/v3/projects/d4f30fb03c074cf095eca44bb871226c/users/f981727938224ccdbe49f1153f45e034/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:39.065783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04a86d-d2e9-40f5-9e5a-336ae858cd15 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:39.070166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 928/1886] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:39 2022] PUT /identity/v3/projects/a149762bdc9441bda9f0c9b2ca3cea3d/users/ce0841e9f74e4958a205ed4e1b78bc26/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:39.074150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18980-bbf4-4102-b460-e758b5ddd4fa admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:39.130623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04a86d-d2e9-40f5-9e5a-336ae858cd15 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:39.135501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8d77a-45a5-49f5-97c3-e323385fc068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:39.136109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d77a-45a5-49f5-97c3-e323385fc068 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.136415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d77a-45a5-49f5-97c3-e323385fc068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.136675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d77a-45a5-49f5-97c3-e323385fc068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.137233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18980-bbf4-4102-b460-e758b5ddd4fa admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:39.137344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8d77a-45a5-49f5-97c3-e323385fc068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:39.139281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8d77a-45a5-49f5-97c3-e323385fc068 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:39.142784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfc5d8-c270-4118-85f4-ae22c4744bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:39.143426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfc5d8-c270-4118-85f4-ae22c4744bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.143704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfc5d8-c270-4118-85f4-ae22c4744bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.143977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfc5d8-c270-4118-85f4-ae22c4744bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.144668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfc5d8-c270-4118-85f4-ae22c4744bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:39.146388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfc5d8-c270-4118-85f4-ae22c4744bd1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:39.149208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 959/1887] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:39.153383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8d77a-45a5-49f5-97c3-e323385fc068 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:39.160075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 929/1888] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:39.163532 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8d77a-45a5-49f5-97c3-e323385fc068 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:39.164202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfc5d8-c270-4118-85f4-ae22c4744bd1 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:39.168477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492c2f7-9d5a-4ff5-8270-669acaf0da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:39.169140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492c2f7-9d5a-4ff5-8270-669acaf0da86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.169418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492c2f7-9d5a-4ff5-8270-669acaf0da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.169688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492c2f7-9d5a-4ff5-8270-669acaf0da86 admin admin] PATH_INFO: `/v3/projects/d4f30fb03c074cf095eca44bb871226c/users/f981727938224ccdbe49f1153f45e034/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.171606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492c2f7-9d5a-4ff5-8270-669acaf0da86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f30fb03c074cf095eca44bb871226c, user_id=f981727938224ccdbe49f1153f45e034, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:39.174373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492c2f7-9d5a-4ff5-8270-669acaf0da86 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:39.174996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfc5d8-c270-4118-85f4-ae22c4744bd1 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:39.177674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:39.180075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa8c9a-20fc-4d9d-8402-5fea2dab34a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:39.180784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa8c9a-20fc-4d9d-8402-5fea2dab34a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.181063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa8c9a-20fc-4d9d-8402-5fea2dab34a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.181848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa8c9a-20fc-4d9d-8402-5fea2dab34a6 admin admin] PATH_INFO: `/v3/projects/a149762bdc9441bda9f0c9b2ca3cea3d/users/ce0841e9f74e4958a205ed4e1b78bc26/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.183810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa8c9a-20fc-4d9d-8402-5fea2dab34a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a149762bdc9441bda9f0c9b2ca3cea3d, user_id=ce0841e9f74e4958a205ed4e1b78bc26, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:39.186509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa8c9a-20fc-4d9d-8402-5fea2dab34a6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:39.186687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 960/1889] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:39 2022] PUT /identity/v3/projects/d4f30fb03c074cf095eca44bb871226c/users/f981727938224ccdbe49f1153f45e034/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:39.197053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30042bc6-75ab-4818-81e0-efaf8dcd882e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.197334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30042bc6-75ab-4818-81e0-efaf8dcd882e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.197625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30042bc6-75ab-4818-81e0-efaf8dcd882e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.198520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 930/1890] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:39 2022] PUT /identity/v3/projects/a149762bdc9441bda9f0c9b2ca3cea3d/users/ce0841e9f74e4958a205ed4e1b78bc26/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:39.209888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4a59-8ab1-438d-99db-28aca2c8f8bf None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.210173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4a59-8ab1-438d-99db-28aca2c8f8bf None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.210446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4a59-8ab1-438d-99db-28aca2c8f8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.227718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-30042bc6-75ab-4818-81e0-efaf8dcd882e None None] MFA Rules not processed for user `f981727938224ccdbe49f1153f45e034`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:39.229206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-30042bc6-75ab-4818-81e0-efaf8dcd882e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:39.240125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-418f4a59-8ab1-438d-99db-28aca2c8f8bf None None] MFA Rules not processed for user `ce0841e9f74e4958a205ed4e1b78bc26`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:39.241378 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-418f4a59-8ab1-438d-99db-28aca2c8f8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:39.299628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 961/1891] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:39.312190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30042bc6-75ab-4818-81e0-efaf8dcd882e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:39.314017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-30042bc6-75ab-4818-81e0-efaf8dcd882e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:39.317111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 931/1892] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:39.327330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f4a59-8ab1-438d-99db-28aca2c8f8bf None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:39.328960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-418f4a59-8ab1-438d-99db-28aca2c8f8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:39.351195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:39.373591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30042bc6-75ab-4818-81e0-efaf8dcd882e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:39.378771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981021ac-872d-421e-95f9-491f6c7e7224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:39.379404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981021ac-872d-421e-95f9-491f6c7e7224 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.379870 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981021ac-872d-421e-95f9-491f6c7e7224 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.380820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981021ac-872d-421e-95f9-491f6c7e7224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.390825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981021ac-872d-421e-95f9-491f6c7e7224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:39.391389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f4a59-8ab1-438d-99db-28aca2c8f8bf None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:39.392281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981021ac-872d-421e-95f9-491f6c7e7224 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:39.395107 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c46778-c639-4ea0-a74b-46e93d389274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:39.395716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c46778-c639-4ea0-a74b-46e93d389274 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:39.396084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c46778-c639-4ea0-a74b-46e93d389274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:39.396278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c46778-c639-4ea0-a74b-46e93d389274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:39.402000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 962/1893] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:39.462174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c46778-c639-4ea0-a74b-46e93d389274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:39.463864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c46778-c639-4ea0-a74b-46e93d389274 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:39.476106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 932/1894] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:39.956765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981021ac-872d-421e-95f9-491f6c7e7224 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:40.071030 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981021ac-872d-421e-95f9-491f6c7e7224 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:40.076041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:40.076811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:40.077154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:40.082619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] PATH_INFO: `/v3/users/fe0495f21ff94d179050c2300686c47e` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:40.084804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe0495f21ff94d179050c2300686c47e)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:40.086844 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:40.124321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:40.152493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe0495f21ff94d179050c2300686c47e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:40.153704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe0495f21ff94d179050c2300686c47e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:40.154114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe0495f21ff94d179050c2300686c47e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:40.162868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe0495f21ff94d179050c2300686c47e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:40.177043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe0495f21ff94d179050c2300686c47e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:40.192477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 963/1895] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:39 2022] DELETE /identity/v3/users/fe0495f21ff94d179050c2300686c47e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:40.197256 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8be1-91e0-4cf4-b568-bfd52a6d3908 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:40.197744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8be1-91e0-4cf4-b568-bfd52a6d3908 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:40.197928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8be1-91e0-4cf4-b568-bfd52a6d3908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:40.218458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-7bdd8be1-91e0-4cf4-b568-bfd52a6d3908 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:40.220641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7bdd8be1-91e0-4cf4-b568-bfd52a6d3908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:40.293565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 933/1896] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:40.307821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:40.309335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:40.379160 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bf6f8-963c-4bfc-9e04-45b3eaf7ddbb admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:40.383712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba045-5799-4d37-b169-e1420ca1b231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:40.384640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba045-5799-4d37-b169-e1420ca1b231 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:40.385108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba045-5799-4d37-b169-e1420ca1b231 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:40.385395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba045-5799-4d37-b169-e1420ca1b231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:40.397954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba045-5799-4d37-b169-e1420ca1b231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:40.399582 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba045-5799-4d37-b169-e1420ca1b231 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:40.413295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 964/1897] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:41.273647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd8be1-91e0-4cf4-b568-bfd52a6d3908 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:41.275515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7bdd8be1-91e0-4cf4-b568-bfd52a6d3908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:41.353616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd8be1-91e0-4cf4-b568-bfd52a6d3908 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:41.358063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a17e1e-0472-44b0-800d-f7b33b173923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:41.359067 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17e1e-0472-44b0-800d-f7b33b173923 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:41.365386 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17e1e-0472-44b0-800d-f7b33b173923 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:41.365945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17e1e-0472-44b0-800d-f7b33b173923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:41.368150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-67a17e1e-0472-44b0-800d-f7b33b173923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:41.386019 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba045-5799-4d37-b169-e1420ca1b231 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:41.388086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8dfba045-5799-4d37-b169-e1420ca1b231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:41.415829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba045-5799-4d37-b169-e1420ca1b231 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:41.424604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:41.425481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:41.426743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:41.427695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:41.428154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] PATH_INFO: `/v3/projects/836e4ae5988c4b1cb90f9a035fbb016b` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:41.431118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=836e4ae5988c4b1cb90f9a035fbb016b)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:41.433740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:41.470818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a17e1e-0472-44b0-800d-f7b33b173923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:41.473337 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a17e1e-0472-44b0-800d-f7b33b173923 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:41.483641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 934/1898] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:41.511174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836e4ae5988c4b1cb90f9a035fbb016b', 'request_id': 'req-f40ef85a-b722-44d4-b9ec-aebed3183095'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.519940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836e4ae5988c4b1cb90f9a035fbb016b', 'request_id': 'req-f40ef85a-b722-44d4-b9ec-aebed3183095'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.528243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836e4ae5988c4b1cb90f9a035fbb016b', 'request_id': 'req-f40ef85a-b722-44d4-b9ec-aebed3183095'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.550519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] The token cache is being invalidate because project 836e4ae5988c4b1cb90f9a035fbb016b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:41.550960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.551612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.553447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 965/1899] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:41 2022] DELETE /identity/v3/projects/836e4ae5988c4b1cb90f9a035fbb016b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:41.558302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a17e1e-0472-44b0-800d-f7b33b173923 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:41.569131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a17e1e-0472-44b0-800d-f7b33b173923 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:41.630935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:41.631820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:41.632114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:41.632431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] PATH_INFO: `/v3/users/f981727938224ccdbe49f1153f45e034` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:41.633736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f981727938224ccdbe49f1153f45e034)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:41.636105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:41.687665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f981727938224ccdbe49f1153f45e034'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.688616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f981727938224ccdbe49f1153f45e034'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.696812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f981727938224ccdbe49f1153f45e034'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.713378 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f981727938224ccdbe49f1153f45e034'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.714247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9facec27-3e0e-4d2f-8163-4540b6b7cfcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f981727938224ccdbe49f1153f45e034'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.733906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 935/1900] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:41 2022] DELETE /identity/v3/users/f981727938224ccdbe49f1153f45e034 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:42.151353 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.153701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:42.194710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ef85a-b722-44d4-b9ec-aebed3183095 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.234088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:42.297606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.298294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.298567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.298839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] PATH_INFO: `/v3/projects/d4f30fb03c074cf095eca44bb871226c` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.300077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f30fb03c074cf095eca44bb871226c)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.303976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.361836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f30fb03c074cf095eca44bb871226c', 'request_id': 'req-90f9addd-ecb6-4724-9342-9761f1b2a59f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:42.368868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f30fb03c074cf095eca44bb871226c', 'request_id': 'req-90f9addd-ecb6-4724-9342-9761f1b2a59f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:42.376541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f30fb03c074cf095eca44bb871226c', 'request_id': 'req-90f9addd-ecb6-4724-9342-9761f1b2a59f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:42.394009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] The token cache is being invalidate because project d4f30fb03c074cf095eca44bb871226c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:42.395454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:42.396662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-90f9addd-ecb6-4724-9342-9761f1b2a59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:42.402413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 966/1901] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:42 2022] DELETE /identity/v3/projects/d4f30fb03c074cf095eca44bb871226c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:42.407931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3d73e-8eb7-4d7c-af77-aba2130d7e93 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.410401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3d73e-8eb7-4d7c-af77-aba2130d7e93 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.410759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3d73e-8eb7-4d7c-af77-aba2130d7e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.453611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-a2a3d73e-8eb7-4d7c-af77-aba2130d7e93 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:42.455414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a2a3d73e-8eb7-4d7c-af77-aba2130d7e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:42.517261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:42.545566 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 936/1902] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:42.555404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149906-de2b-4bda-b82c-cfebf236cf8a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.555834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149906-de2b-4bda-b82c-cfebf236cf8a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.556214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149906-de2b-4bda-b82c-cfebf236cf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.580546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3d149906-de2b-4bda-b82c-cfebf236cf8a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:42.587536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3d149906-de2b-4bda-b82c-cfebf236cf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:42.601498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 967/1903] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:42.606045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3d73e-8eb7-4d7c-af77-aba2130d7e93 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.616367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3d73e-8eb7-4d7c-af77-aba2130d7e93 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.622409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5059e2-afd5-496f-afa8-43dbb9865214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.623035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5059e2-afd5-496f-afa8-43dbb9865214 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.623314 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5059e2-afd5-496f-afa8-43dbb9865214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.623584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5059e2-afd5-496f-afa8-43dbb9865214 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.624235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5059e2-afd5-496f-afa8-43dbb9865214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:42.624562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5059e2-afd5-496f-afa8-43dbb9865214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.626333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5059e2-afd5-496f-afa8-43dbb9865214 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.640402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 937/1904] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:27:42.644010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149906-de2b-4bda-b82c-cfebf236cf8a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.654050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149906-de2b-4bda-b82c-cfebf236cf8a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.659672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a51a4-4914-4bef-a6a8-fedac9cc9844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.660305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a51a4-4914-4bef-a6a8-fedac9cc9844 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.660621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a51a4-4914-4bef-a6a8-fedac9cc9844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.660899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a51a4-4914-4bef-a6a8-fedac9cc9844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.661546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a51a4-4914-4bef-a6a8-fedac9cc9844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.663478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a51a4-4914-4bef-a6a8-fedac9cc9844 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.693968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 968/1905] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:42.698449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5059e2-afd5-496f-afa8-43dbb9865214 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.708718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5059e2-afd5-496f-afa8-43dbb9865214 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.769888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9462542-7bcd-4b21-8ffb-e4c73bc1273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.770500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9462542-7bcd-4b21-8ffb-e4c73bc1273b admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.770840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9462542-7bcd-4b21-8ffb-e4c73bc1273b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.771112 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9462542-7bcd-4b21-8ffb-e4c73bc1273b admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.771758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9462542-7bcd-4b21-8ffb-e4c73bc1273b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.773744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9462542-7bcd-4b21-8ffb-e4c73bc1273b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.797284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 938/1906] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:42.801873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a51a4-4914-4bef-a6a8-fedac9cc9844 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.813164 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a51a4-4914-4bef-a6a8-fedac9cc9844 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.818151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef4731-7b95-42a8-8212-aff14841e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.818740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef4731-7b95-42a8-8212-aff14841e66f admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.819018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef4731-7b95-42a8-8212-aff14841e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.819292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef4731-7b95-42a8-8212-aff14841e66f admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.819941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef4731-7b95-42a8-8212-aff14841e66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.821872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef4731-7b95-42a8-8212-aff14841e66f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.832966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 969/1907] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:42.837518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9462542-7bcd-4b21-8ffb-e4c73bc1273b admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.847827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9462542-7bcd-4b21-8ffb-e4c73bc1273b admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.853717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78205d4-8a50-4cfb-a426-fa055585206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.854357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78205d4-8a50-4cfb-a426-fa055585206d admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.854633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78205d4-8a50-4cfb-a426-fa055585206d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.854903 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78205d4-8a50-4cfb-a426-fa055585206d admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.855591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78205d4-8a50-4cfb-a426-fa055585206d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.857237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78205d4-8a50-4cfb-a426-fa055585206d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.868917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 939/1908] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:42.873555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef4731-7b95-42a8-8212-aff14841e66f admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.883816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef4731-7b95-42a8-8212-aff14841e66f admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.889538 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b21cf-d849-424e-9364-215653e9e84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.890216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b21cf-d849-424e-9364-215653e9e84e admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.890491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b21cf-d849-424e-9364-215653e9e84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.890762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b21cf-d849-424e-9364-215653e9e84e admin admin] PATH_INFO: `/v3/projects/934782b380634d3a8cd50d61575362e6/users/07367a6433cd4d259e79e349d90692b1/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.906776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b21cf-d849-424e-9364-215653e9e84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=934782b380634d3a8cd50d61575362e6, user_id=07367a6433cd4d259e79e349d90692b1, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.909562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b21cf-d849-424e-9364-215653e9e84e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.925402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 970/1909] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:42 2022] PUT /identity/v3/projects/934782b380634d3a8cd50d61575362e6/users/07367a6433cd4d259e79e349d90692b1/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:42.939916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751efe2-b4d6-4dc2-9b32-bf644b540d51 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.940155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751efe2-b4d6-4dc2-9b32-bf644b540d51 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.940477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751efe2-b4d6-4dc2-9b32-bf644b540d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.973857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-9751efe2-b4d6-4dc2-9b32-bf644b540d51 None None] MFA Rules not processed for user `07367a6433cd4d259e79e349d90692b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:42.975670 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9751efe2-b4d6-4dc2-9b32-bf644b540d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:43.048428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 940/1910] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:43.053110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b21cf-d849-424e-9364-215653e9e84e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.117034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:43.122434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b21cf-d849-424e-9364-215653e9e84e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.128069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f4455-20f3-4ad0-bd80-b7a46a971cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.129197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f4455-20f3-4ad0-bd80-b7a46a971cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.129463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f4455-20f3-4ad0-bd80-b7a46a971cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.129829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f4455-20f3-4ad0-bd80-b7a46a971cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.130683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f4455-20f3-4ad0-bd80-b7a46a971cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.132900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f4455-20f3-4ad0-bd80-b7a46a971cd0 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.162142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 971/1911] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:43 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:43.166416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751efe2-b4d6-4dc2-9b32-bf644b540d51 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.178130 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751efe2-b4d6-4dc2-9b32-bf644b540d51 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.223302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:43.241432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecfc65-cb23-47f3-ada0-e4711fc6eb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.242076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecfc65-cb23-47f3-ada0-e4711fc6eb7a admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.242374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecfc65-cb23-47f3-ada0-e4711fc6eb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.242639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecfc65-cb23-47f3-ada0-e4711fc6eb7a admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.243462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecfc65-cb23-47f3-ada0-e4711fc6eb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.245538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecfc65-cb23-47f3-ada0-e4711fc6eb7a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.269958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 941/1912] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:43 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:43.275274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f4455-20f3-4ad0-bd80-b7a46a971cd0 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.287210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f4455-20f3-4ad0-bd80-b7a46a971cd0 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.292034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609fe38-ed1f-474d-8372-a508daeac645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.292777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609fe38-ed1f-474d-8372-a508daeac645 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.293169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609fe38-ed1f-474d-8372-a508daeac645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.293537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609fe38-ed1f-474d-8372-a508daeac645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.294238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609fe38-ed1f-474d-8372-a508daeac645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.295881 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609fe38-ed1f-474d-8372-a508daeac645 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.298402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecfc65-cb23-47f3-ada0-e4711fc6eb7a admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.301141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b8ecfc65-cb23-47f3-ada0-e4711fc6eb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:43.310927 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 972/1913] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:43.311806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609fe38-ed1f-474d-8372-a508daeac645 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.316106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecfc65-cb23-47f3-ada0-e4711fc6eb7a admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.322480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609fe38-ed1f-474d-8372-a508daeac645 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.323680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.324324 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.324624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.325459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] PATH_INFO: `/v3/users/b8d933a8b2a245f792cf8c63e2f09cfb` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.326438 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d933a8b2a245f792cf8c63e2f09cfb)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.328247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.329963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233e9d-8ea2-48c8-b76f-b982a42bb582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.330716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233e9d-8ea2-48c8-b76f-b982a42bb582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.330994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233e9d-8ea2-48c8-b76f-b982a42bb582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.331270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233e9d-8ea2-48c8-b76f-b982a42bb582 admin admin] PATH_INFO: `/v3/projects/7290be7e365c44ccb5d5b7a263461ea0/users/ac9b2ac978e94de38e7487ab0218a949/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.347444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57233e9d-8ea2-48c8-b76f-b982a42bb582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7290be7e365c44ccb5d5b7a263461ea0, user_id=ac9b2ac978e94de38e7487ab0218a949, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.350409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57233e9d-8ea2-48c8-b76f-b982a42bb582 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.364689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 973/1914] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:43 2022] PUT /identity/v3/projects/7290be7e365c44ccb5d5b7a263461ea0/users/ac9b2ac978e94de38e7487ab0218a949/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:43.368981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233e9d-8ea2-48c8-b76f-b982a42bb582 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.395449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d933a8b2a245f792cf8c63e2f09cfb'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:43.396198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d933a8b2a245f792cf8c63e2f09cfb'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:43.406160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d933a8b2a245f792cf8c63e2f09cfb'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:43.420583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d933a8b2a245f792cf8c63e2f09cfb'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:43.421760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8acc5d62-2dc6-49b9-841e-7ac75488f594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d933a8b2a245f792cf8c63e2f09cfb'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:43.444119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 942/1915] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:43 2022] DELETE /identity/v3/users/b8d933a8b2a245f792cf8c63e2f09cfb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:43.446602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233e9d-8ea2-48c8-b76f-b982a42bb582 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.451549 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7ccb-057f-466b-b763-d5ffffdc9891 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.451843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7ccb-057f-466b-b763-d5ffffdc9891 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.452743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7ccb-057f-466b-b763-d5ffffdc9891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.489464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-897b7ccb-057f-466b-b763-d5ffffdc9891 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:43.491127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-897b7ccb-057f-466b-b763-d5ffffdc9891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:43.538298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d0132-03f1-4717-a73d-ec2c9a75831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.538940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0132-03f1-4717-a73d-ec2c9a75831a admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.539217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0132-03f1-4717-a73d-ec2c9a75831a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.539735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0132-03f1-4717-a73d-ec2c9a75831a admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.540561 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d0132-03f1-4717-a73d-ec2c9a75831a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.542176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d0132-03f1-4717-a73d-ec2c9a75831a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.558605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 974/1916] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:43.563637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d0132-03f1-4717-a73d-ec2c9a75831a admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.565703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-231d0132-03f1-4717-a73d-ec2c9a75831a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:43.583798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d0132-03f1-4717-a73d-ec2c9a75831a admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.590656 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ba488-5515-4093-bfca-acf01ac813ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.591455 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ba488-5515-4093-bfca-acf01ac813ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.592369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ba488-5515-4093-bfca-acf01ac813ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.592995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ba488-5515-4093-bfca-acf01ac813ef admin admin] PATH_INFO: `/v3/projects/7290be7e365c44ccb5d5b7a263461ea0/users/ac9b2ac978e94de38e7487ab0218a949/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.595245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ba488-5515-4093-bfca-acf01ac813ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7290be7e365c44ccb5d5b7a263461ea0, user_id=ac9b2ac978e94de38e7487ab0218a949, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.599294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ba488-5515-4093-bfca-acf01ac813ef admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.620702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 975/1917] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:43 2022] PUT /identity/v3/projects/7290be7e365c44ccb5d5b7a263461ea0/users/ac9b2ac978e94de38e7487ab0218a949/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:43.625700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c1c04-2b8f-4ab5-987c-38370773fbd9 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.626048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c1c04-2b8f-4ab5-987c-38370773fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.627006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c1c04-2b8f-4ab5-987c-38370773fbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.656372 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 943/1918] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:43.671180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-e76c1c04-2b8f-4ab5-987c-38370773fbd9 None None] MFA Rules not processed for user `ac9b2ac978e94de38e7487ab0218a949`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:43.673205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e76c1c04-2b8f-4ab5-987c-38370773fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:43.682338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7ccb-057f-466b-b763-d5ffffdc9891 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.684373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-897b7ccb-057f-466b-b763-d5ffffdc9891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:43.713074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:43.752866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:43.772113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7ccb-057f-466b-b763-d5ffffdc9891 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.797823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 976/1919] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:43.808497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c1c04-2b8f-4ab5-987c-38370773fbd9 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.811310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e76c1c04-2b8f-4ab5-987c-38370773fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:43.849505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375628cf-a045-46d9-a40d-7c84b2c102ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.850498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375628cf-a045-46d9-a40d-7c84b2c102ac service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.850777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375628cf-a045-46d9-a40d-7c84b2c102ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.851043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375628cf-a045-46d9-a40d-7c84b2c102ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.922300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c1c04-2b8f-4ab5-987c-38370773fbd9 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.928587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54d068-7e20-486c-b531-4725efd8d921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.929436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d068-7e20-486c-b531-4725efd8d921 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.929868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d068-7e20-486c-b531-4725efd8d921 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.930302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d068-7e20-486c-b531-4725efd8d921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.933086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-eb54d068-7e20-486c-b531-4725efd8d921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:43.940204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375628cf-a045-46d9-a40d-7c84b2c102ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.942001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375628cf-a045-46d9-a40d-7c84b2c102ac service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.954658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 944/1920] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:44.030834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54d068-7e20-486c-b531-4725efd8d921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:44.033687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54d068-7e20-486c-b531-4725efd8d921 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:44.046214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 977/1921] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:44.288415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375628cf-a045-46d9-a40d-7c84b2c102ac service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:44.290628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-375628cf-a045-46d9-a40d-7c84b2c102ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:44.307274 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375628cf-a045-46d9-a40d-7c84b2c102ac service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:44.313579 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:44.314242 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:44.314525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:44.314802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] PATH_INFO: `/v3/users/dc68c3c441c34f3fa06a4b2915d25b09` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:44.316013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc68c3c441c34f3fa06a4b2915d25b09)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:44.318533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:44.393801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc68c3c441c34f3fa06a4b2915d25b09'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:44.396427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc68c3c441c34f3fa06a4b2915d25b09'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:44.408222 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc68c3c441c34f3fa06a4b2915d25b09'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:44.461756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc68c3c441c34f3fa06a4b2915d25b09'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:44.463181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc68c3c441c34f3fa06a4b2915d25b09'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:44.494985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 945/1922] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:44 2022] DELETE /identity/v3/users/dc68c3c441c34f3fa06a4b2915d25b09 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:44.500312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16738f-ff75-4e46-8f04-a1906fc91502 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:44.500804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16738f-ff75-4e46-8f04-a1906fc91502 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:44.501013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16738f-ff75-4e46-8f04-a1906fc91502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:44.592713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8a16738f-ff75-4e46-8f04-a1906fc91502 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:44.594336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8a16738f-ff75-4e46-8f04-a1906fc91502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:44.682625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 978/1923] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:44.707032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:44.709781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:44.768040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:44.828340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16738f-ff75-4e46-8f04-a1906fc91502 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:44.830125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8a16738f-ff75-4e46-8f04-a1906fc91502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:44.846396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a81b3-f519-4e68-9268-e334e0fde6aa admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:44.849402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16738f-ff75-4e46-8f04-a1906fc91502 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:44.856979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a9554-9156-4f30-85ca-f53ec8b4c3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:44.857918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9554-9156-4f30-85ca-f53ec8b4c3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:44.858397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9554-9156-4f30-85ca-f53ec8b4c3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:44.858882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9554-9156-4f30-85ca-f53ec8b4c3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:44.864677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:44.865362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:44.867381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:44.867723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] PATH_INFO: `/v3/projects/6ba74988081f4971adb8aab5705743f3` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:44.869067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba74988081f4971adb8aab5705743f3)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:44.871318 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:44.888753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a9554-9156-4f30-85ca-f53ec8b4c3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:44.890924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a9554-9156-4f30-85ca-f53ec8b4c3d4 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:44.905523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 946/1924] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:44.912368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:44.969701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba74988081f4971adb8aab5705743f3', 'request_id': 'req-79d85570-681e-4f56-889b-3e7a1463e572'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:44.981001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba74988081f4971adb8aab5705743f3', 'request_id': 'req-79d85570-681e-4f56-889b-3e7a1463e572'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:44.989830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba74988081f4971adb8aab5705743f3', 'request_id': 'req-79d85570-681e-4f56-889b-3e7a1463e572'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.007704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] The token cache is being invalidate because project 6ba74988081f4971adb8aab5705743f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:45.008130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.008955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.011049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 979/1925] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:44 2022] DELETE /identity/v3/projects/6ba74988081f4971adb8aab5705743f3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:45.015318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a9554-9156-4f30-85ca-f53ec8b4c3d4 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:45.026691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a9554-9156-4f30-85ca-f53ec8b4c3d4 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:45.091152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:45.092006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:45.092285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:45.092597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] PATH_INFO: `/v3/users/ce0841e9f74e4958a205ed4e1b78bc26` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:45.094317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0841e9f74e4958a205ed4e1b78bc26)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:45.096251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:45.157793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0841e9f74e4958a205ed4e1b78bc26'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.158452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0841e9f74e4958a205ed4e1b78bc26'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.165530 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0841e9f74e4958a205ed4e1b78bc26'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.179012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0841e9f74e4958a205ed4e1b78bc26'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.179975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0841e9f74e4958a205ed4e1b78bc26'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.196747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 947/1926] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:45 2022] DELETE /identity/v3/users/ce0841e9f74e4958a205ed4e1b78bc26 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:45.278084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:45.279632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:45.294622 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d85570-681e-4f56-889b-3e7a1463e572 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:45.392143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:45.392836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:45.393198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:45.393429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] PATH_INFO: `/v3/projects/71fabb8c87194fa39b5d2ecdc65dbac3` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:45.394587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fabb8c87194fa39b5d2ecdc65dbac3)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:45.396651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:45.461822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fabb8c87194fa39b5d2ecdc65dbac3', 'request_id': 'req-fd5de34d-e308-4479-9bc8-2ce946d28e20'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.468737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fabb8c87194fa39b5d2ecdc65dbac3', 'request_id': 'req-fd5de34d-e308-4479-9bc8-2ce946d28e20'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.475612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fabb8c87194fa39b5d2ecdc65dbac3', 'request_id': 'req-fd5de34d-e308-4479-9bc8-2ce946d28e20'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.492831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] The token cache is being invalidate because project 71fabb8c87194fa39b5d2ecdc65dbac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:45.493302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.494592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.496711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 980/1927] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:45 2022] DELETE /identity/v3/projects/71fabb8c87194fa39b5d2ecdc65dbac3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:45.501017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:45.505796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:45.524634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0f793-c3c7-4784-857d-a379007cb6bb admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:45.581805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:45.602714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:45.604691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:45.622858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:45.624942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:45.625224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:45.625910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] PATH_INFO: `/v3/users/6204441e0ce842fdba4e07e6a3f30e92` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:45.626729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6204441e0ce842fdba4e07e6a3f30e92)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:45.628739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:45.636810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5de34d-e308-4479-9bc8-2ce946d28e20 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:45.649557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:45.650708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:45.651291 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:45.652555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] PATH_INFO: `/v3/projects/a149762bdc9441bda9f0c9b2ca3cea3d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:45.655814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a149762bdc9441bda9f0c9b2ca3cea3d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:45.663134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:45.707174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:45.708461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6204441e0ce842fdba4e07e6a3f30e92'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.709181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6204441e0ce842fdba4e07e6a3f30e92'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.724037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6204441e0ce842fdba4e07e6a3f30e92'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.749410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6204441e0ce842fdba4e07e6a3f30e92'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.751094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-38d0a6d0-db44-445c-8261-d3ecf2bc330e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6204441e0ce842fdba4e07e6a3f30e92'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.759057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a149762bdc9441bda9f0c9b2ca3cea3d', 'request_id': 'req-d8da173e-1239-416a-b3ab-3375f33e6c6f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.774633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 948/1928] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:45 2022] DELETE /identity/v3/users/6204441e0ce842fdba4e07e6a3f30e92 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:45.779234 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a149762bdc9441bda9f0c9b2ca3cea3d', 'request_id': 'req-d8da173e-1239-416a-b3ab-3375f33e6c6f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.795873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a149762bdc9441bda9f0c9b2ca3cea3d', 'request_id': 'req-d8da173e-1239-416a-b3ab-3375f33e6c6f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.824568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] The token cache is being invalidate because project a149762bdc9441bda9f0c9b2ca3cea3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:45.825084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.827156 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8da173e-1239-416a-b3ab-3375f33e6c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:45.830718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 981/1929] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:45 2022] DELETE /identity/v3/projects/a149762bdc9441bda9f0c9b2ca3cea3d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:45.837533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed3d1-0a07-4af4-9b0e-d484b8f0b13a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:45.838101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed3d1-0a07-4af4-9b0e-d484b8f0b13a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:45.838585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed3d1-0a07-4af4-9b0e-d484b8f0b13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:45.877220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-794ed3d1-0a07-4af4-9b0e-d484b8f0b13a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:45.878713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-794ed3d1-0a07-4af4-9b0e-d484b8f0b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:45.962452 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 949/1930] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:45.970741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a1373-0a57-43d4-bb9b-3dd7b378aba6 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:45.971026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a1373-0a57-43d4-bb9b-3dd7b378aba6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:45.971351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a1373-0a57-43d4-bb9b-3dd7b378aba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:45.992192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1b7a1373-0a57-43d4-bb9b-3dd7b378aba6 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:45.993495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1b7a1373-0a57-43d4-bb9b-3dd7b378aba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:46.001986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 982/1931] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:46.006458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed3d1-0a07-4af4-9b0e-d484b8f0b13a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.019235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed3d1-0a07-4af4-9b0e-d484b8f0b13a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.023882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88a74e-d7b0-4826-90d7-ca001cb1e0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.024699 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88a74e-d7b0-4826-90d7-ca001cb1e0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.025195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88a74e-d7b0-4826-90d7-ca001cb1e0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.025195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88a74e-d7b0-4826-90d7-ca001cb1e0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.025769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88a74e-d7b0-4826-90d7-ca001cb1e0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:46.026070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88a74e-d7b0-4826-90d7-ca001cb1e0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.027676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88a74e-d7b0-4826-90d7-ca001cb1e0c2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.039510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 950/1932] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:27:46.044242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a1373-0a57-43d4-bb9b-3dd7b378aba6 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.053821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a1373-0a57-43d4-bb9b-3dd7b378aba6 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.058859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9404fa-3165-4c6b-be2b-9e59124afe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.059545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9404fa-3165-4c6b-be2b-9e59124afe8f admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.059829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9404fa-3165-4c6b-be2b-9e59124afe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.060086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9404fa-3165-4c6b-be2b-9e59124afe8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.060898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9404fa-3165-4c6b-be2b-9e59124afe8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.062933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9404fa-3165-4c6b-be2b-9e59124afe8f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.094131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 983/1933] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:46 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:46.098564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88a74e-d7b0-4826-90d7-ca001cb1e0c2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.109426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88a74e-d7b0-4826-90d7-ca001cb1e0c2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.136774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9404fa-3165-4c6b-be2b-9e59124afe8f admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.138913 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-be9404fa-3165-4c6b-be2b-9e59124afe8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:46.177353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:46.190993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5e620-fc83-458f-b8e6-770536fa9858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.193355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5e620-fc83-458f-b8e6-770536fa9858 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.193816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5e620-fc83-458f-b8e6-770536fa9858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.194303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5e620-fc83-458f-b8e6-770536fa9858 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.195048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5e620-fc83-458f-b8e6-770536fa9858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.197731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5e620-fc83-458f-b8e6-770536fa9858 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.221848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9404fa-3165-4c6b-be2b-9e59124afe8f admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.222086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 951/1934] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:46 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:46.225857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5e620-fc83-458f-b8e6-770536fa9858 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.229731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.230581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.231166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.231439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] PATH_INFO: `/v3/projects/a249cc3da821467fae16fa41eb328d44` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.232624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a249cc3da821467fae16fa41eb328d44)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.234561 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.239717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5e620-fc83-458f-b8e6-770536fa9858 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.246133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fe00e-5c80-4d25-bcf9-2ccff1631992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.246959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fe00e-5c80-4d25-bcf9-2ccff1631992 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.247133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fe00e-5c80-4d25-bcf9-2ccff1631992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.247401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fe00e-5c80-4d25-bcf9-2ccff1631992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.248083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fe00e-5c80-4d25-bcf9-2ccff1631992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.249776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fe00e-5c80-4d25-bcf9-2ccff1631992 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.262303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 952/1935] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:46.267700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fe00e-5c80-4d25-bcf9-2ccff1631992 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.281020 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fe00e-5c80-4d25-bcf9-2ccff1631992 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.294002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a249cc3da821467fae16fa41eb328d44', 'request_id': 'req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:46.304315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a249cc3da821467fae16fa41eb328d44', 'request_id': 'req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:46.311614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a249cc3da821467fae16fa41eb328d44', 'request_id': 'req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:46.332092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] The token cache is being invalidate because project a249cc3da821467fae16fa41eb328d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:46.332235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:46.333163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:46.334727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 984/1936] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:46 2022] DELETE /identity/v3/projects/a249cc3da821467fae16fa41eb328d44 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:46.339122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.340448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:46.356578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:46.359893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13d91d-a8b8-4631-bb49-e4884b4838d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.361220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13d91d-a8b8-4631-bb49-e4884b4838d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.361521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13d91d-a8b8-4631-bb49-e4884b4838d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.361792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13d91d-a8b8-4631-bb49-e4884b4838d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.362444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13d91d-a8b8-4631-bb49-e4884b4838d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.364331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13d91d-a8b8-4631-bb49-e4884b4838d2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.375946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 953/1937] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:46.380101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13d91d-a8b8-4631-bb49-e4884b4838d2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.381889 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-cb13d91d-a8b8-4631-bb49-e4884b4838d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:46.396599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13d91d-a8b8-4631-bb49-e4884b4838d2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.402147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff5866-3c22-4967-b998-122352f985e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.402816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5866-3c22-4967-b998-122352f985e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.403093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5866-3c22-4967-b998-122352f985e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.403366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5866-3c22-4967-b998-122352f985e8 admin admin] PATH_INFO: `/v3/projects/8e7b896f5a59470c923e3e431f66b0bd/users/5a7a9cb361db4034ad33d74c887b767d/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.411480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af00f2d-b5c1-4cd0-bb9b-314acbb36710 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.418585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.419323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.419665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.420007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] PATH_INFO: `/v3/users/354340241cf540e696fb3c7713a7e463` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.420551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff5866-3c22-4967-b998-122352f985e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7b896f5a59470c923e3e431f66b0bd, user_id=5a7a9cb361db4034ad33d74c887b767d, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.421278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] RBAC: Authorizing `identity:delete_user(user_id=354340241cf540e696fb3c7713a7e463)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.423284 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.423662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff5866-3c22-4967-b998-122352f985e8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.443193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 954/1938] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:46 2022] PUT /identity/v3/projects/8e7b896f5a59470c923e3e431f66b0bd/users/5a7a9cb361db4034ad33d74c887b767d/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:46.460888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f2b7-b87f-42bb-8cf4-e985e8bf742c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.461105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f2b7-b87f-42bb-8cf4-e985e8bf742c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.461393 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f2b7-b87f-42bb-8cf4-e985e8bf742c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.497379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-55d4f2b7-b87f-42bb-8cf4-e985e8bf742c None None] MFA Rules not processed for user `5a7a9cb361db4034ad33d74c887b767d`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:46.498962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-55d4f2b7-b87f-42bb-8cf4-e985e8bf742c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:46.503539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354340241cf540e696fb3c7713a7e463'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:46.504210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354340241cf540e696fb3c7713a7e463'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:46.505069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354340241cf540e696fb3c7713a7e463'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:46.514456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354340241cf540e696fb3c7713a7e463'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:46.531617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354340241cf540e696fb3c7713a7e463'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:46.549268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 985/1939] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:46 2022] DELETE /identity/v3/users/354340241cf540e696fb3c7713a7e463 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:46.581279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 955/1940] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:46.586013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.587992 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:46.666632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bb67f-f304-4e26-8572-9cccd601415f admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.671861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adeb27-676a-462e-bdc3-5ea66e238892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.672594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adeb27-676a-462e-bdc3-5ea66e238892 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.672910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adeb27-676a-462e-bdc3-5ea66e238892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.673181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adeb27-676a-462e-bdc3-5ea66e238892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.673804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adeb27-676a-462e-bdc3-5ea66e238892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.675747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adeb27-676a-462e-bdc3-5ea66e238892 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.712631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 986/1941] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:46 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:46.713790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4f2b7-b87f-42bb-8cf4-e985e8bf742c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.747918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:46.786512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4f2b7-b87f-42bb-8cf4-e985e8bf742c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.838751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adeb27-676a-462e-bdc3-5ea66e238892 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.840660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-57adeb27-676a-462e-bdc3-5ea66e238892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:46.852927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c006f14-746a-4160-9117-a18829a84a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.853724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c006f14-746a-4160-9117-a18829a84a02 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.854224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c006f14-746a-4160-9117-a18829a84a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.854701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c006f14-746a-4160-9117-a18829a84a02 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.855367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c006f14-746a-4160-9117-a18829a84a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.857861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c006f14-746a-4160-9117-a18829a84a02 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.868420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:46.889600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 956/1942] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:46 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:46.893437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c006f14-746a-4160-9117-a18829a84a02 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.903266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c006f14-746a-4160-9117-a18829a84a02 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.907799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e513e95-3d1c-4b02-b89c-553a80948706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.908401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513e95-3d1c-4b02-b89c-553a80948706 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.908686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513e95-3d1c-4b02-b89c-553a80948706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.908953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513e95-3d1c-4b02-b89c-553a80948706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.909640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e513e95-3d1c-4b02-b89c-553a80948706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.911172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e513e95-3d1c-4b02-b89c-553a80948706 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.919104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adeb27-676a-462e-bdc3-5ea66e238892 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.922605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 957/1943] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:46.926851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.927011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e513e95-3d1c-4b02-b89c-553a80948706 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.927504 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.927783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.928057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] PATH_INFO: `/v3/projects/0722cbf18551435c912b0a34bb321eb2` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.929252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0722cbf18551435c912b0a34bb321eb2)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.931358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.939039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e513e95-3d1c-4b02-b89c-553a80948706 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.944321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1be17f-5c70-4317-8206-a6015e38ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.944967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be17f-5c70-4317-8206-a6015e38ee22 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.945381 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be17f-5c70-4317-8206-a6015e38ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.945656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be17f-5c70-4317-8206-a6015e38ee22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:46.946338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1be17f-5c70-4317-8206-a6015e38ee22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:46.948166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1be17f-5c70-4317-8206-a6015e38ee22 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:46.963199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 958/1944] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:46.967346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1be17f-5c70-4317-8206-a6015e38ee22 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:46.979603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1be17f-5c70-4317-8206-a6015e38ee22 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:46.992412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55726b6-cfa9-4ec5-8d90-920339da90bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:46.993339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55726b6-cfa9-4ec5-8d90-920339da90bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:46.993705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55726b6-cfa9-4ec5-8d90-920339da90bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:46.994129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55726b6-cfa9-4ec5-8d90-920339da90bd admin admin] PATH_INFO: `/v3/projects/3d5a84e9b23e45af89673aee43427d8a/users/53f01b3c1f244e3184ecc6f179fef5b9/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.010709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55726b6-cfa9-4ec5-8d90-920339da90bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5a84e9b23e45af89673aee43427d8a, user_id=53f01b3c1f244e3184ecc6f179fef5b9, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.012402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0722cbf18551435c912b0a34bb321eb2', 'request_id': 'req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:47.013942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55726b6-cfa9-4ec5-8d90-920339da90bd admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.021451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0722cbf18551435c912b0a34bb321eb2', 'request_id': 'req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:47.028358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0722cbf18551435c912b0a34bb321eb2', 'request_id': 'req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:47.032569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 959/1945] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:46 2022] PUT /identity/v3/projects/3d5a84e9b23e45af89673aee43427d8a/users/53f01b3c1f244e3184ecc6f179fef5b9/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:47.040270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58d12-1ae9-42d9-969b-233c07bedbbe None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.040693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58d12-1ae9-42d9-969b-233c07bedbbe None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.040972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58d12-1ae9-42d9-969b-233c07bedbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.046361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] The token cache is being invalidate because project 0722cbf18551435c912b0a34bb321eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:47.046651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:47.047300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f4cc543b-8045-4d42-a343-7f1b2ac90bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:47.049080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 987/1946] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:46 2022] DELETE /identity/v3/projects/0722cbf18551435c912b0a34bb321eb2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:47.055243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708ac0b-8182-492f-8791-f9e86f865dcf None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.055605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708ac0b-8182-492f-8791-f9e86f865dcf None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.056423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708ac0b-8182-492f-8791-f9e86f865dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.070686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2ac58d12-1ae9-42d9-969b-233c07bedbbe None None] MFA Rules not processed for user `53f01b3c1f244e3184ecc6f179fef5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:47.071937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2ac58d12-1ae9-42d9-969b-233c07bedbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:47.078045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3708ac0b-8182-492f-8791-f9e86f865dcf None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:47.079273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3708ac0b-8182-492f-8791-f9e86f865dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:47.144520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 988/1947] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:47.144719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 960/1948] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:47.145923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708ac0b-8182-492f-8791-f9e86f865dcf None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.147225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3708ac0b-8182-492f-8791-f9e86f865dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:47.149832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4fd44-16cb-491b-9df6-7890038bdc06 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.150111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4fd44-16cb-491b-9df6-7890038bdc06 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.150393 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4fd44-16cb-491b-9df6-7890038bdc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.159005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708ac0b-8182-492f-8791-f9e86f865dcf None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.163488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94c327-a6cd-4daf-823e-3ddce4ccc8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.164085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94c327-a6cd-4daf-823e-3ddce4ccc8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.164358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94c327-a6cd-4daf-823e-3ddce4ccc8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.164679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94c327-a6cd-4daf-823e-3ddce4ccc8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.165445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94c327-a6cd-4daf-823e-3ddce4ccc8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.167399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94c327-a6cd-4daf-823e-3ddce4ccc8c6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.169755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2ef4fd44-16cb-491b-9df6-7890038bdc06 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:47.170934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2ef4fd44-16cb-491b-9df6-7890038bdc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:47.179256 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 961/1949] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:47.184214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4fd44-16cb-491b-9df6-7890038bdc06 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.190651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:47.194817 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4fd44-16cb-491b-9df6-7890038bdc06 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.197214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 989/1950] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:47.201812 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94c327-a6cd-4daf-823e-3ddce4ccc8c6 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.233467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:47.259851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5d83a-4fe4-46b7-999d-98f62dd1b73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.260507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d83a-4fe4-46b7-999d-98f62dd1b73e admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.260797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d83a-4fe4-46b7-999d-98f62dd1b73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.261070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d83a-4fe4-46b7-999d-98f62dd1b73e admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.261724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d83a-4fe4-46b7-999d-98f62dd1b73e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:47.262026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d83a-4fe4-46b7-999d-98f62dd1b73e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.263996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d83a-4fe4-46b7-999d-98f62dd1b73e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.269330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94c327-a6cd-4daf-823e-3ddce4ccc8c6 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.274998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2876-be4e-4cc5-9d39-d37c0e519bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.275604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2876-be4e-4cc5-9d39-d37c0e519bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.275876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2876-be4e-4cc5-9d39-d37c0e519bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.276147 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2876-be4e-4cc5-9d39-d37c0e519bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.276897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc2876-be4e-4cc5-9d39-d37c0e519bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.278839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc2876-be4e-4cc5-9d39-d37c0e519bc2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.279449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 962/1951] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:27:47.280172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5d83a-4fe4-46b7-999d-98f62dd1b73e admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.290902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5d83a-4fe4-46b7-999d-98f62dd1b73e admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.296472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24476e9-96ec-4fcd-ac1c-5ca289069fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.297131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24476e9-96ec-4fcd-ac1c-5ca289069fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.297441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24476e9-96ec-4fcd-ac1c-5ca289069fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.297782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24476e9-96ec-4fcd-ac1c-5ca289069fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.298499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24476e9-96ec-4fcd-ac1c-5ca289069fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.300399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24476e9-96ec-4fcd-ac1c-5ca289069fa1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.302250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 990/1952] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:47.307146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2876-be4e-4cc5-9d39-d37c0e519bc2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.316664 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2876-be4e-4cc5-9d39-d37c0e519bc2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.321721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebb4f7-5420-449f-8df0-e04098b26756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.322409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebb4f7-5420-449f-8df0-e04098b26756 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.322684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebb4f7-5420-449f-8df0-e04098b26756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.322981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebb4f7-5420-449f-8df0-e04098b26756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.323686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebb4f7-5420-449f-8df0-e04098b26756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.325498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebb4f7-5420-449f-8df0-e04098b26756 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.336681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 991/1953] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:47.340487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebb4f7-5420-449f-8df0-e04098b26756 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.341971 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 963/1954] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:47.345879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24476e9-96ec-4fcd-ac1c-5ca289069fa1 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.350998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebb4f7-5420-449f-8df0-e04098b26756 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.415365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24476e9-96ec-4fcd-ac1c-5ca289069fa1 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.419466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca81f14-d081-4c84-950c-529a8bf0dc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.420203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81f14-d081-4c84-950c-529a8bf0dc07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.420521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81f14-d081-4c84-950c-529a8bf0dc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.420801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81f14-d081-4c84-950c-529a8bf0dc07 admin admin] PATH_INFO: `/v3/projects/c79b16a040444ef2a4f30630e4e38407/users/681b30a21e174cb6936c0213db5ce5b2/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.422173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53c88c-379a-4996-aee1-305dc34cbad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.422372 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53c88c-379a-4996-aee1-305dc34cbad9 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.422657 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53c88c-379a-4996-aee1-305dc34cbad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.422928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53c88c-379a-4996-aee1-305dc34cbad9 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.423814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53c88c-379a-4996-aee1-305dc34cbad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.426773 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53c88c-379a-4996-aee1-305dc34cbad9 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.436662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca81f14-d081-4c84-950c-529a8bf0dc07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79b16a040444ef2a4f30630e4e38407, user_id=681b30a21e174cb6936c0213db5ce5b2, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.440677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca81f14-d081-4c84-950c-529a8bf0dc07 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.453150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 964/1955] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:47.456823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53c88c-379a-4996-aee1-305dc34cbad9 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.459375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 992/1956] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:47 2022] PUT /identity/v3/projects/c79b16a040444ef2a4f30630e4e38407/users/681b30a21e174cb6936c0213db5ce5b2/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:47.463694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca81f14-d081-4c84-950c-529a8bf0dc07 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.468089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53c88c-379a-4996-aee1-305dc34cbad9 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.531623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658dc2-2e8f-41a9-ad85-0ddfd456963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.532244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658dc2-2e8f-41a9-ad85-0ddfd456963c admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.532680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658dc2-2e8f-41a9-ad85-0ddfd456963c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.532957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658dc2-2e8f-41a9-ad85-0ddfd456963c admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.533612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb658dc2-2e8f-41a9-ad85-0ddfd456963c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.535385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb658dc2-2e8f-41a9-ad85-0ddfd456963c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.547342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 965/1957] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:47.551214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658dc2-2e8f-41a9-ad85-0ddfd456963c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.556882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:47.557358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca81f14-d081-4c84-950c-529a8bf0dc07 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.562371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658dc2-2e8f-41a9-ad85-0ddfd456963c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.563129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e7beb-4d98-4d7a-9c46-a564fccc4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.563748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e7beb-4d98-4d7a-9c46-a564fccc4137 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.564027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e7beb-4d98-4d7a-9c46-a564fccc4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.564306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e7beb-4d98-4d7a-9c46-a564fccc4137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.565001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e7beb-4d98-4d7a-9c46-a564fccc4137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.566705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e7beb-4d98-4d7a-9c46-a564fccc4137 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.570151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47ca8-dfc0-41dc-a95a-9a8d88a12253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.570928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47ca8-dfc0-41dc-a95a-9a8d88a12253 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.571320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47ca8-dfc0-41dc-a95a-9a8d88a12253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.571607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47ca8-dfc0-41dc-a95a-9a8d88a12253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.572329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc47ca8-dfc0-41dc-a95a-9a8d88a12253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.573991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc47ca8-dfc0-41dc-a95a-9a8d88a12253 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.579439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 993/1958] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:47.583503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e7beb-4d98-4d7a-9c46-a564fccc4137 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.585771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 966/1959] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:47.590658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47ca8-dfc0-41dc-a95a-9a8d88a12253 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.601130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e7beb-4d98-4d7a-9c46-a564fccc4137 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.605885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47ca8-dfc0-41dc-a95a-9a8d88a12253 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.606020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb478bf-e4f4-4fa0-aeb5-c216e2132aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.606695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb478bf-e4f4-4fa0-aeb5-c216e2132aac admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.606967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb478bf-e4f4-4fa0-aeb5-c216e2132aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.607239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb478bf-e4f4-4fa0-aeb5-c216e2132aac admin admin] PATH_INFO: `/v3/projects/c79b16a040444ef2a4f30630e4e38407/users/681b30a21e174cb6936c0213db5ce5b2/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.609199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb478bf-e4f4-4fa0-aeb5-c216e2132aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79b16a040444ef2a4f30630e4e38407, user_id=681b30a21e174cb6936c0213db5ce5b2, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.610942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba113e-d0a6-4259-a80a-bed5c9fc6485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.611591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba113e-d0a6-4259-a80a-bed5c9fc6485 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.611869 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba113e-d0a6-4259-a80a-bed5c9fc6485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.612051 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb478bf-e4f4-4fa0-aeb5-c216e2132aac admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.612146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba113e-d0a6-4259-a80a-bed5c9fc6485 admin admin] PATH_INFO: `/v3/projects/96a61aada8d84cc2b810751d064496c8/users/e6693948f14041f88d2cd533c479977e/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.626170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 994/1960] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:47 2022] PUT /identity/v3/projects/c79b16a040444ef2a4f30630e4e38407/users/681b30a21e174cb6936c0213db5ce5b2/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:47.628140 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba113e-d0a6-4259-a80a-bed5c9fc6485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a61aada8d84cc2b810751d064496c8, user_id=e6693948f14041f88d2cd533c479977e, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.631099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba113e-d0a6-4259-a80a-bed5c9fc6485 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.636824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770a21-4b78-4757-afa3-9341b5e19a8b None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.637108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770a21-4b78-4757-afa3-9341b5e19a8b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.637379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770a21-4b78-4757-afa3-9341b5e19a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.657231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 967/1961] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:47 2022] PUT /identity/v3/projects/96a61aada8d84cc2b810751d064496c8/users/e6693948f14041f88d2cd533c479977e/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:47.662866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:47.669134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1ed5-03dc-4561-807b-e627ce14e92f None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.669435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1ed5-03dc-4561-807b-e627ce14e92f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.670671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1ed5-03dc-4561-807b-e627ce14e92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.674454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-b6770a21-4b78-4757-afa3-9341b5e19a8b None None] MFA Rules not processed for user `681b30a21e174cb6936c0213db5ce5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:47.676431 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b6770a21-4b78-4757-afa3-9341b5e19a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:47.729899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e2bb1ed5-03dc-4561-807b-e627ce14e92f None None] MFA Rules not processed for user `e6693948f14041f88d2cd533c479977e`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:47.731289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e2bb1ed5-03dc-4561-807b-e627ce14e92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:47.756374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 995/1962] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:47.771126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6770a21-4b78-4757-afa3-9341b5e19a8b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.772757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b6770a21-4b78-4757-afa3-9341b5e19a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:47.815256 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 968/1963] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:27:47.819805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1ed5-03dc-4561-807b-e627ce14e92f None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.837958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6770a21-4b78-4757-afa3-9341b5e19a8b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.846269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd6216-9eea-4438-b27d-42ca211f04f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.847282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6216-9eea-4438-b27d-42ca211f04f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.847559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6216-9eea-4438-b27d-42ca211f04f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.847830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6216-9eea-4438-b27d-42ca211f04f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.850134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ffbd6216-9eea-4438-b27d-42ca211f04f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:47.889013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1ed5-03dc-4561-807b-e627ce14e92f None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.893453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317b3bd-281b-404f-b546-985df1296788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:47.894067 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317b3bd-281b-404f-b546-985df1296788 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:47.894338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317b3bd-281b-404f-b546-985df1296788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:47.894606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317b3bd-281b-404f-b546-985df1296788 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:47.895244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317b3bd-281b-404f-b546-985df1296788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.897189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317b3bd-281b-404f-b546-985df1296788 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.911706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd6216-9eea-4438-b27d-42ca211f04f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:47.913203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd6216-9eea-4438-b27d-42ca211f04f6 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:47.923489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 996/1964] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:27:47.925972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 969/1965] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:47.929947 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd6216-9eea-4438-b27d-42ca211f04f6 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:47.941246 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd6216-9eea-4438-b27d-42ca211f04f6 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:47.991526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:48.002838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb0ad-9335-464d-a58b-ea74503a1980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:48.003560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb0ad-9335-464d-a58b-ea74503a1980 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:48.003906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb0ad-9335-464d-a58b-ea74503a1980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:48.004265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb0ad-9335-464d-a58b-ea74503a1980 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:48.004998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cb0ad-9335-464d-a58b-ea74503a1980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:48.006955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cb0ad-9335-464d-a58b-ea74503a1980 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:48.035797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 997/1966] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:47 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:48.044985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317b3bd-281b-404f-b546-985df1296788 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:48.055339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317b3bd-281b-404f-b546-985df1296788 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:48.060907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c6bb1-05ee-44c3-ae84-41d1e48c12e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:48.061526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c6bb1-05ee-44c3-ae84-41d1e48c12e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:48.061844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c6bb1-05ee-44c3-ae84-41d1e48c12e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:48.062077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c6bb1-05ee-44c3-ae84-41d1e48c12e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:48.062722 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c6bb1-05ee-44c3-ae84-41d1e48c12e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:48.064315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c6bb1-05ee-44c3-ae84-41d1e48c12e0 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:48.075314 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 970/1967] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:27:48.080152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb0ad-9335-464d-a58b-ea74503a1980 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:48.092508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb0ad-9335-464d-a58b-ea74503a1980 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:48.097311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aab4d-d3e1-4f15-ba56-7f598584176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:48.098016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aab4d-d3e1-4f15-ba56-7f598584176b admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:48.098286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aab4d-d3e1-4f15-ba56-7f598584176b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:48.098574 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aab4d-d3e1-4f15-ba56-7f598584176b admin admin] PATH_INFO: `/v3/projects/ae9fc5aca87d4e5081f11215157136a8/users/0b04b595e8814e5bbe89ea6c0e243f7c/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:48.115938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093aab4d-d3e1-4f15-ba56-7f598584176b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9fc5aca87d4e5081f11215157136a8, user_id=0b04b595e8814e5bbe89ea6c0e243f7c, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:48.120279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093aab4d-d3e1-4f15-ba56-7f598584176b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:48.139349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 998/1968] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:48 2022] PUT /identity/v3/projects/ae9fc5aca87d4e5081f11215157136a8/users/0b04b595e8814e5bbe89ea6c0e243f7c/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:48.143672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c6bb1-05ee-44c3-ae84-41d1e48c12e0 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:48.154864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c6bb1-05ee-44c3-ae84-41d1e48c12e0 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:48.199591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:48.254946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05367d0f-ec06-48e8-96c2-a8866b75afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:48.255623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05367d0f-ec06-48e8-96c2-a8866b75afa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:48.255972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05367d0f-ec06-48e8-96c2-a8866b75afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:48.256274 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05367d0f-ec06-48e8-96c2-a8866b75afa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:48.257003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05367d0f-ec06-48e8-96c2-a8866b75afa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:48.259079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05367d0f-ec06-48e8-96c2-a8866b75afa5 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:48.271791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 971/1969] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:48.275971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aab4d-d3e1-4f15-ba56-7f598584176b admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:48.286828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aab4d-d3e1-4f15-ba56-7f598584176b admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:48.292582 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5716a1c-0eaa-4b41-9ccf-490d68e335c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:48.293411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5716a1c-0eaa-4b41-9ccf-490d68e335c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:48.293816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5716a1c-0eaa-4b41-9ccf-490d68e335c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:48.294125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5716a1c-0eaa-4b41-9ccf-490d68e335c8 admin admin] PATH_INFO: `/v3/projects/ae9fc5aca87d4e5081f11215157136a8/users/0b04b595e8814e5bbe89ea6c0e243f7c/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:48.296220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5716a1c-0eaa-4b41-9ccf-490d68e335c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9fc5aca87d4e5081f11215157136a8, user_id=0b04b595e8814e5bbe89ea6c0e243f7c, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:48.299184 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5716a1c-0eaa-4b41-9ccf-490d68e335c8 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:48.311243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 999/1970] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:48 2022] PUT /identity/v3/projects/ae9fc5aca87d4e5081f11215157136a8/users/0b04b595e8814e5bbe89ea6c0e243f7c/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:48.323423 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39f96-7b80-4fe4-9f03-2c1c2f5e8126 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:48.323750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39f96-7b80-4fe4-9f03-2c1c2f5e8126 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:48.324027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39f96-7b80-4fe4-9f03-2c1c2f5e8126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:48.353627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2be39f96-7b80-4fe4-9f03-2c1c2f5e8126 None None] MFA Rules not processed for user `0b04b595e8814e5bbe89ea6c0e243f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:48.354833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2be39f96-7b80-4fe4-9f03-2c1c2f5e8126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:48.425765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 972/1971] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:48 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:48.437585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5716a1c-0eaa-4b41-9ccf-490d68e335c8 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:48.497576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5716a1c-0eaa-4b41-9ccf-490d68e335c8 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:48.501797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1660c-46c4-484b-8299-672f6c4c1e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:48.502420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1660c-46c4-484b-8299-672f6c4c1e5a service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:48.502696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1660c-46c4-484b-8299-672f6c4c1e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:48.502965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1660c-46c4-484b-8299-672f6c4c1e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:48.513524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1660c-46c4-484b-8299-672f6c4c1e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:48.514981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1660c-46c4-484b-8299-672f6c4c1e5a service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:48.525279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1000/1972] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:48.676176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39f96-7b80-4fe4-9f03-2c1c2f5e8126 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:48.739744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39f96-7b80-4fe4-9f03-2c1c2f5e8126 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:48.744506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:48.745069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:48.745347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:48.745652 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] PATH_INFO: `/v3/users/e6693948f14041f88d2cd533c479977e` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:48.746770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6693948f14041f88d2cd533c479977e)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:48.748729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:48.800503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6693948f14041f88d2cd533c479977e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:48.801251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6693948f14041f88d2cd533c479977e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:48.807074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:48.809486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6693948f14041f88d2cd533c479977e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:48.823281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6693948f14041f88d2cd533c479977e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:48.824036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6693948f14041f88d2cd533c479977e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:48.840309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 973/1973] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:48 2022] DELETE /identity/v3/users/e6693948f14041f88d2cd533c479977e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:48.844650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba8b22-e270-46ed-8096-90a5344adfa9 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:48.845100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba8b22-e270-46ed-8096-90a5344adfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:48.845294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba8b22-e270-46ed-8096-90a5344adfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:48.865643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-a0ba8b22-e270-46ed-8096-90a5344adfa9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:48.866858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a0ba8b22-e270-46ed-8096-90a5344adfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:48.934204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1001/1974] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:48.943656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:48.945219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:49.006153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d25a38-20d2-4b24-8def-51b7565a2e86 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:49.010152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276dd5-a281-4bb4-93a5-616749494d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:49.010767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276dd5-a281-4bb4-93a5-616749494d08 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:49.011047 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276dd5-a281-4bb4-93a5-616749494d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:49.011320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276dd5-a281-4bb4-93a5-616749494d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:49.022122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276dd5-a281-4bb4-93a5-616749494d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:49.023571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276dd5-a281-4bb4-93a5-616749494d08 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:49.034008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 974/1975] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:49.318054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba8b22-e270-46ed-8096-90a5344adfa9 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:49.319961 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a0ba8b22-e270-46ed-8096-90a5344adfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:49.335429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba8b22-e270-46ed-8096-90a5344adfa9 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:49.343307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:49.343971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:49.345063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:49.345348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] PATH_INFO: `/v3/projects/96a61aada8d84cc2b810751d064496c8` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:49.346937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a61aada8d84cc2b810751d064496c8)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:49.348889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:49.392719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:49.399772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a61aada8d84cc2b810751d064496c8', 'request_id': 'req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:49.409614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a61aada8d84cc2b810751d064496c8', 'request_id': 'req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:49.417288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a61aada8d84cc2b810751d064496c8', 'request_id': 'req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:49.442869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] The token cache is being invalidate because project 96a61aada8d84cc2b810751d064496c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:49.443081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:49.443760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:49.445360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1002/1976] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:49 2022] DELETE /identity/v3/projects/96a61aada8d84cc2b810751d064496c8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:49.449529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276dd5-a281-4bb4-93a5-616749494d08 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:49.459730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276dd5-a281-4bb4-93a5-616749494d08 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:49.525049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:49.525687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:49.525962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:49.526236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] PATH_INFO: `/v3/users/0b04b595e8814e5bbe89ea6c0e243f7c` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:49.527356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b04b595e8814e5bbe89ea6c0e243f7c)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:49.529351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:49.593554 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b04b595e8814e5bbe89ea6c0e243f7c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:49.593851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b04b595e8814e5bbe89ea6c0e243f7c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:49.614482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b04b595e8814e5bbe89ea6c0e243f7c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:49.635692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b04b595e8814e5bbe89ea6c0e243f7c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:49.636585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5057a96a-b4d2-4ecf-97b8-12fb388e03b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b04b595e8814e5bbe89ea6c0e243f7c'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:49.642310 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:49.659900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 975/1977] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:49 2022] DELETE /identity/v3/users/0b04b595e8814e5bbe89ea6c0e243f7c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:50.214067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:50.215591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:50.232028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72d8c-33ed-48b3-86f8-b9c66da86ac0 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:50.322808 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:50.323795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:50.324139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:50.324511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] PATH_INFO: `/v3/projects/ae9fc5aca87d4e5081f11215157136a8` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:50.327366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9fc5aca87d4e5081f11215157136a8)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:50.329667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:50.400619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9fc5aca87d4e5081f11215157136a8', 'request_id': 'req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:50.407331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9fc5aca87d4e5081f11215157136a8', 'request_id': 'req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:50.415820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9fc5aca87d4e5081f11215157136a8', 'request_id': 'req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:50.433464 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] The token cache is being invalidate because project ae9fc5aca87d4e5081f11215157136a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:50.433919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:50.434583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-04ab93e3-eadc-4f9b-962f-d1d7600d2d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:50.436191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1003/1978] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:50 2022] DELETE /identity/v3/projects/ae9fc5aca87d4e5081f11215157136a8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:50.441291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129120d-429c-4f81-a324-990795018682 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:50.441847 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129120d-429c-4f81-a324-990795018682 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:50.441847 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129120d-429c-4f81-a324-990795018682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:50.473323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6129120d-429c-4f81-a324-990795018682 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:50.475164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6129120d-429c-4f81-a324-990795018682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:50.563613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 976/1979] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:50.572163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724f11d-3e61-4d14-9cbd-80c22356a143 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:50.572462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724f11d-3e61-4d14-9cbd-80c22356a143 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:50.572736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724f11d-3e61-4d14-9cbd-80c22356a143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:50.595514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3724f11d-3e61-4d14-9cbd-80c22356a143 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:50.596875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3724f11d-3e61-4d14-9cbd-80c22356a143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:50.605783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1004/1980] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:50.610595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129120d-429c-4f81-a324-990795018682 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:50.621206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129120d-429c-4f81-a324-990795018682 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:50.626180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e2c0b-9115-44d7-8499-d09a02db3169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:50.626803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2c0b-9115-44d7-8499-d09a02db3169 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:50.627081 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2c0b-9115-44d7-8499-d09a02db3169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:50.627354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2c0b-9115-44d7-8499-d09a02db3169 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:50.628012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e2c0b-9115-44d7-8499-d09a02db3169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:50.628308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e2c0b-9115-44d7-8499-d09a02db3169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:50.629956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e2c0b-9115-44d7-8499-d09a02db3169 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:50.643050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 977/1981] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:27:50.647219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724f11d-3e61-4d14-9cbd-80c22356a143 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:50.657274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724f11d-3e61-4d14-9cbd-80c22356a143 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:50.662363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70656b73-4792-4eeb-ba3b-a450cb171c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:50.662981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70656b73-4792-4eeb-ba3b-a450cb171c33 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:50.663251 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70656b73-4792-4eeb-ba3b-a450cb171c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:50.663531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70656b73-4792-4eeb-ba3b-a450cb171c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:50.664183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70656b73-4792-4eeb-ba3b-a450cb171c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:50.666208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70656b73-4792-4eeb-ba3b-a450cb171c33 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:50.696905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1005/1982] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:50 2022] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:50.702739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e2c0b-9115-44d7-8499-d09a02db3169 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:50.713148 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e2c0b-9115-44d7-8499-d09a02db3169 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:50.769122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee469-b0a3-4757-9b28-4fde950800d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:50.769835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee469-b0a3-4757-9b28-4fde950800d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:50.770101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee469-b0a3-4757-9b28-4fde950800d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:50.770374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee469-b0a3-4757-9b28-4fde950800d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:50.771020 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feee469-b0a3-4757-9b28-4fde950800d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:50.772979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feee469-b0a3-4757-9b28-4fde950800d2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:50.797520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 978/1983] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:50 2022] POST /identity/v3/users => generated 305 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:50.801816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70656b73-4792-4eeb-ba3b-a450cb171c33 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:50.812099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70656b73-4792-4eeb-ba3b-a450cb171c33 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:50.816752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e71b4b-ab58-422d-80d0-9c96739ed7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:50.817350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71b4b-ab58-422d-80d0-9c96739ed7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:50.817624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71b4b-ab58-422d-80d0-9c96739ed7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:50.817890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71b4b-ab58-422d-80d0-9c96739ed7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:50.818561 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e71b4b-ab58-422d-80d0-9c96739ed7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:50.820215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e71b4b-ab58-422d-80d0-9c96739ed7c0 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:50.830397 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1006/1984] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:50.834737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee469-b0a3-4757-9b28-4fde950800d2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:50.845499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee469-b0a3-4757-9b28-4fde950800d2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:50.851024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ee7fc-dd6c-465c-8721-09b751a6a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:50.851650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ee7fc-dd6c-465c-8721-09b751a6a7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:50.851936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ee7fc-dd6c-465c-8721-09b751a6a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:50.852346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ee7fc-dd6c-465c-8721-09b751a6a7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:50.853051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ee7fc-dd6c-465c-8721-09b751a6a7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:50.854678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ee7fc-dd6c-465c-8721-09b751a6a7a7 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:50.865560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 979/1985] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:50.870174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e71b4b-ab58-422d-80d0-9c96739ed7c0 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:50.880762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e71b4b-ab58-422d-80d0-9c96739ed7c0 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:50.886048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730cbda-6754-483d-a09b-978da91efd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:50.886701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730cbda-6754-483d-a09b-978da91efd4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:50.886955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730cbda-6754-483d-a09b-978da91efd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:50.887222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730cbda-6754-483d-a09b-978da91efd4c admin admin] PATH_INFO: `/v3/projects/ebdb080ddf534838957b4981d75716c7/users/4ec1ae0635ac41ada841a8e192f206ff/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:50.902214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730cbda-6754-483d-a09b-978da91efd4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdb080ddf534838957b4981d75716c7, user_id=4ec1ae0635ac41ada841a8e192f206ff, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:50.904934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730cbda-6754-483d-a09b-978da91efd4c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:50.907837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:50.924238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1007/1986] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:50 2022] PUT /identity/v3/projects/ebdb080ddf534838957b4981d75716c7/users/4ec1ae0635ac41ada841a8e192f206ff/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:50.936225 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c082cb5-dbe0-4bf2-9c84-b923fabb3b6a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:50.936553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c082cb5-dbe0-4bf2-9c84-b923fabb3b6a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:50.936831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c082cb5-dbe0-4bf2-9c84-b923fabb3b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:50.966724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-3c082cb5-dbe0-4bf2-9c84-b923fabb3b6a None None] MFA Rules not processed for user `4ec1ae0635ac41ada841a8e192f206ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:50.967923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3c082cb5-dbe0-4bf2-9c84-b923fabb3b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:51.019936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:51.042919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 980/1987] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:50 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:51.047699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730cbda-6754-483d-a09b-978da91efd4c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:51.114494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730cbda-6754-483d-a09b-978da91efd4c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:51.119912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab00d2-7635-4286-b528-709423c32296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:51.120707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab00d2-7635-4286-b528-709423c32296 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:51.120986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab00d2-7635-4286-b528-709423c32296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:51.121256 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab00d2-7635-4286-b528-709423c32296 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:51.121901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab00d2-7635-4286-b528-709423c32296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:51.125970 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab00d2-7635-4286-b528-709423c32296 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:51.158088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1008/1988] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:51 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:51.163115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c082cb5-dbe0-4bf2-9c84-b923fabb3b6a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:51.174657 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c082cb5-dbe0-4bf2-9c84-b923fabb3b6a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:51.232747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268eadf-bb8b-453c-b203-f3cf5dea6ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:51.233363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268eadf-bb8b-453c-b203-f3cf5dea6ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:51.233728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268eadf-bb8b-453c-b203-f3cf5dea6ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:51.233986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268eadf-bb8b-453c-b203-f3cf5dea6ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:51.234645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268eadf-bb8b-453c-b203-f3cf5dea6ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:51.236617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268eadf-bb8b-453c-b203-f3cf5dea6ef4 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:51.260737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 981/1989] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:51 2022] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:51.265789 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab00d2-7635-4286-b528-709423c32296 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:51.277410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab00d2-7635-4286-b528-709423c32296 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:51.282941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f407c6e-8eb6-40b1-9efb-165c7bed9d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:51.283554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f407c6e-8eb6-40b1-9efb-165c7bed9d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:51.283819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f407c6e-8eb6-40b1-9efb-165c7bed9d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:51.284086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f407c6e-8eb6-40b1-9efb-165c7bed9d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:51.284776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f407c6e-8eb6-40b1-9efb-165c7bed9d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:51.286425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f407c6e-8eb6-40b1-9efb-165c7bed9d9a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:51.298257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1009/1990] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:51.302465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268eadf-bb8b-453c-b203-f3cf5dea6ef4 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:51.313403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268eadf-bb8b-453c-b203-f3cf5dea6ef4 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:51.318926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdee693-47cd-4d63-8d7f-ca9b4b3afe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:51.319684 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee693-47cd-4d63-8d7f-ca9b4b3afe21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:51.320035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee693-47cd-4d63-8d7f-ca9b4b3afe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:51.320370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee693-47cd-4d63-8d7f-ca9b4b3afe21 admin admin] PATH_INFO: `/v3/projects/fb30413082c6491381fb4e1c13b0979b/users/bbea45ee81d54858b866a7bff1c25a2e/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:51.337606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdee693-47cd-4d63-8d7f-ca9b4b3afe21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb30413082c6491381fb4e1c13b0979b, user_id=bbea45ee81d54858b866a7bff1c25a2e, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:51.339963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdee693-47cd-4d63-8d7f-ca9b4b3afe21 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:51.360580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 982/1991] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:51 2022] PUT /identity/v3/projects/fb30413082c6491381fb4e1c13b0979b/users/bbea45ee81d54858b866a7bff1c25a2e/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:51.362061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f407c6e-8eb6-40b1-9efb-165c7bed9d9a admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:51.372711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f407c6e-8eb6-40b1-9efb-165c7bed9d9a admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:51.439294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179304ee-b506-4826-8fff-7a8bf6a4f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:51.439918 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179304ee-b506-4826-8fff-7a8bf6a4f4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:51.440196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179304ee-b506-4826-8fff-7a8bf6a4f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:51.440489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179304ee-b506-4826-8fff-7a8bf6a4f4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:51.441144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179304ee-b506-4826-8fff-7a8bf6a4f4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:51.442735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179304ee-b506-4826-8fff-7a8bf6a4f4c5 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:51.455884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1010/1992] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:51.458424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdee693-47cd-4d63-8d7f-ca9b4b3afe21 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:51.469076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdee693-47cd-4d63-8d7f-ca9b4b3afe21 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:51.474455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5457fbc-a993-4235-a8d9-474be5999a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:51.475168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5457fbc-a993-4235-a8d9-474be5999a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:51.475426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5457fbc-a993-4235-a8d9-474be5999a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:51.475702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5457fbc-a993-4235-a8d9-474be5999a93 admin admin] PATH_INFO: `/v3/projects/fb30413082c6491381fb4e1c13b0979b/users/bbea45ee81d54858b866a7bff1c25a2e/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:51.477990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5457fbc-a993-4235-a8d9-474be5999a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb30413082c6491381fb4e1c13b0979b, user_id=bbea45ee81d54858b866a7bff1c25a2e, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:51.480681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5457fbc-a993-4235-a8d9-474be5999a93 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:51.491581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 983/1993] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:51 2022] PUT /identity/v3/projects/fb30413082c6491381fb4e1c13b0979b/users/bbea45ee81d54858b866a7bff1c25a2e/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:51.502087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae294f00-5cf1-41bc-a939-cb592d45fdab None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:51.502377 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae294f00-5cf1-41bc-a939-cb592d45fdab None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:51.502652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae294f00-5cf1-41bc-a939-cb592d45fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:51.531892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ae294f00-5cf1-41bc-a939-cb592d45fdab None None] MFA Rules not processed for user `bbea45ee81d54858b866a7bff1c25a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:51.533111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ae294f00-5cf1-41bc-a939-cb592d45fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:51.586547 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:51.610059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1011/1994] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:27:51 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:51.623377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5457fbc-a993-4235-a8d9-474be5999a93 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:51.625375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e5457fbc-a993-4235-a8d9-474be5999a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:51.698141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5457fbc-a993-4235-a8d9-474be5999a93 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:51.702298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4af5e-b81b-40f7-a200-861f8294f51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:51.702912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4af5e-b81b-40f7-a200-861f8294f51f service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:51.703192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4af5e-b81b-40f7-a200-861f8294f51f service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:51.703464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4af5e-b81b-40f7-a200-861f8294f51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:51.713084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4af5e-b81b-40f7-a200-861f8294f51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:51.714524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4af5e-b81b-40f7-a200-861f8294f51f service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:51.724824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 984/1995] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:51 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:27:51.898158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae294f00-5cf1-41bc-a939-cb592d45fdab None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:51.907849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae294f00-5cf1-41bc-a939-cb592d45fdab None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:51.911370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf363ad-2fe2-48c6-ba11-dd1b7e7bf973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:51.911986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf363ad-2fe2-48c6-ba11-dd1b7e7bf973 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:51.912264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf363ad-2fe2-48c6-ba11-dd1b7e7bf973 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:51.912585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf363ad-2fe2-48c6-ba11-dd1b7e7bf973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:51.968809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf363ad-2fe2-48c6-ba11-dd1b7e7bf973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:51.970263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf363ad-2fe2-48c6-ba11-dd1b7e7bf973 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:51.979938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1012/1996] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:51 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:55.272024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4af5e-b81b-40f7-a200-861f8294f51f service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:55.273525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-15f4af5e-b81b-40f7-a200-861f8294f51f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:55.285802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4af5e-b81b-40f7-a200-861f8294f51f service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:55.290141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323733ec-56ba-48e1-9546-e6b9234c9593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:55.290799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323733ec-56ba-48e1-9546-e6b9234c9593 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:55.291036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323733ec-56ba-48e1-9546-e6b9234c9593 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:55.291323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323733ec-56ba-48e1-9546-e6b9234c9593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:55.293311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-323733ec-56ba-48e1-9546-e6b9234c9593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:55.341009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:55.367883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323733ec-56ba-48e1-9546-e6b9234c9593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:55.369944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323733ec-56ba-48e1-9546-e6b9234c9593 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:55.380130 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 985/1997] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:55.863819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf363ad-2fe2-48c6-ba11-dd1b7e7bf973 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:55.873358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf363ad-2fe2-48c6-ba11-dd1b7e7bf973 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:55.879004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151fdf-2b31-4a53-8490-53b825d14bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:55.879922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151fdf-2b31-4a53-8490-53b825d14bbe service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:55.880202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151fdf-2b31-4a53-8490-53b825d14bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:55.880503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151fdf-2b31-4a53-8490-53b825d14bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:55.896852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-43151fdf-2b31-4a53-8490-53b825d14bbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:55.986276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43151fdf-2b31-4a53-8490-53b825d14bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:55.987816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43151fdf-2b31-4a53-8490-53b825d14bbe service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:55.997590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1013/1998] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:56.114551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cd2ae-92ae-4c16-afb3-c9719d013574 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:56.114901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cd2ae-92ae-4c16-afb3-c9719d013574 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:56.115107 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cd2ae-92ae-4c16-afb3-c9719d013574 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:56.116768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 986/1999] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:27:56.137917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc0dc1-7e49-43ba-a322-09759a3b6391 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:56.138711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc0dc1-7e49-43ba-a322-09759a3b6391 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:56.138997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc0dc1-7e49-43ba-a322-09759a3b6391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:56.187068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-dedc0dc1-7e49-43ba-a322-09759a3b6391 None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:56.190408 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-dedc0dc1-7e49-43ba-a322-09759a3b6391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:56.312518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1014/2000] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:27:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:56.325169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cd2ae-92ae-4c16-afb3-c9719d013574 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:56.326863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-544cd2ae-92ae-4c16-afb3-c9719d013574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:56.344363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cd2ae-92ae-4c16-afb3-c9719d013574 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:56.349938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0e711-03fb-4d07-837f-c197a4ae3c1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:56.350553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0e711-03fb-4d07-837f-c197a4ae3c1e service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:56.350830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0e711-03fb-4d07-837f-c197a4ae3c1e service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:56.351104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0e711-03fb-4d07-837f-c197a4ae3c1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:56.360398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0e711-03fb-4d07-837f-c197a4ae3c1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:56.362036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0e711-03fb-4d07-837f-c197a4ae3c1e service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:56.372543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 987/2001] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:59.023911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc0dc1-7e49-43ba-a322-09759a3b6391 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:59.033705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc0dc1-7e49-43ba-a322-09759a3b6391 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:59.038518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e834377-b684-4932-b8d5-1ffba98a6866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:59.039130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834377-b684-4932-b8d5-1ffba98a6866 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:59.039409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834377-b684-4932-b8d5-1ffba98a6866 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:59.039686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834377-b684-4932-b8d5-1ffba98a6866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:59.042103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3e834377-b684-4932-b8d5-1ffba98a6866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:59.061252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:59.107872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e834377-b684-4932-b8d5-1ffba98a6866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:59.109361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e834377-b684-4932-b8d5-1ffba98a6866 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:59.119063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1015/2002] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:06.368112 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=16 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:09.114634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=21 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:14.168569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0e711-03fb-4d07-837f-c197a4ae3c1e service nova] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.248331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0e711-03fb-4d07-837f-c197a4ae3c1e service nova] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.254250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.255418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.255542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.255890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] PATH_INFO: `/v3/users/4ec1ae0635ac41ada841a8e192f206ff` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.257499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec1ae0635ac41ada841a8e192f206ff)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.260149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.399924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec1ae0635ac41ada841a8e192f206ff'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:14.399924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec1ae0635ac41ada841a8e192f206ff'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:14.416296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec1ae0635ac41ada841a8e192f206ff'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:14.454898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec1ae0635ac41ada841a8e192f206ff'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:14.455770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec1ae0635ac41ada841a8e192f206ff'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:14.482262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 988/2003] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:14 2022] DELETE /identity/v3/users/4ec1ae0635ac41ada841a8e192f206ff => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:14.485402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2752af-bbae-4895-83e1-eb8ca05946ef None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.486311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2752af-bbae-4895-83e1-eb8ca05946ef None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.487134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2752af-bbae-4895-83e1-eb8ca05946ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.495937 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.497697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:14.515605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ba2752af-bbae-4895-83e1-eb8ca05946ef None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:14.517094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ba2752af-bbae-4895-83e1-eb8ca05946ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:14.610835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb9eb-5ab6-471f-a5ae-082e1d79f49b admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.615844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.616548 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.616831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.617108 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] PATH_INFO: `/v3/users/bda6b923d5d049f793d30f7c9791a2cd` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.618280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda6b923d5d049f793d30f7c9791a2cd)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.620730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.642510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1016/2004] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:14.652702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2752af-bbae-4895-83e1-eb8ca05946ef None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.654911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ba2752af-bbae-4895-83e1-eb8ca05946ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:14.665434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:14.704298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda6b923d5d049f793d30f7c9791a2cd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:14.705098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda6b923d5d049f793d30f7c9791a2cd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:14.718218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda6b923d5d049f793d30f7c9791a2cd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:14.733967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda6b923d5d049f793d30f7c9791a2cd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:14.734705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-7c44bde4-cc19-48b4-bdbc-60e98bc40906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda6b923d5d049f793d30f7c9791a2cd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:14.734983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2752af-bbae-4895-83e1-eb8ca05946ef None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.738842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24613e53-3217-42bb-9874-82f0407e0573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.739461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24613e53-3217-42bb-9874-82f0407e0573 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.739742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24613e53-3217-42bb-9874-82f0407e0573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.740585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24613e53-3217-42bb-9874-82f0407e0573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.741794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-24613e53-3217-42bb-9874-82f0407e0573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:14.750791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 989/2005] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:14 2022] DELETE /identity/v3/users/bda6b923d5d049f793d30f7c9791a2cd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:14.755408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2cfe0-06bd-408c-a45f-28f5d2934701 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.755696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2cfe0-06bd-408c-a45f-28f5d2934701 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.756018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2cfe0-06bd-408c-a45f-28f5d2934701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.756129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24613e53-3217-42bb-9874-82f0407e0573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.757608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24613e53-3217-42bb-9874-82f0407e0573 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.770657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1017/2006] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:28:14.777955 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-a9f2cfe0-06bd-408c-a45f-28f5d2934701 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:14.779246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a9f2cfe0-06bd-408c-a45f-28f5d2934701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:14.894789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 990/2007] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:28:14.914669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24613e53-3217-42bb-9874-82f0407e0573 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.916183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-24613e53-3217-42bb-9874-82f0407e0573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:14.943405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24613e53-3217-42bb-9874-82f0407e0573 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:15.025697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f141ac3-71dd-49a9-b129-85c38a1c0042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:15.025923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141ac3-71dd-49a9-b129-85c38a1c0042 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:15.026088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141ac3-71dd-49a9-b129-85c38a1c0042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:15.026502 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141ac3-71dd-49a9-b129-85c38a1c0042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:15.036841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f141ac3-71dd-49a9-b129-85c38a1c0042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:15.045233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f141ac3-71dd-49a9-b129-85c38a1c0042 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:15.072938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1018/2008] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:15.395572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2cfe0-06bd-408c-a45f-28f5d2934701 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:15.397167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a9f2cfe0-06bd-408c-a45f-28f5d2934701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:15.412052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2cfe0-06bd-408c-a45f-28f5d2934701 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:15.417255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:15.418227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:15.418646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:15.419106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] PATH_INFO: `/v3/projects/ebdb080ddf534838957b4981d75716c7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:15.420438 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdb080ddf534838957b4981d75716c7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:15.422703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:15.495018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdb080ddf534838957b4981d75716c7', 'request_id': 'req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.502952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdb080ddf534838957b4981d75716c7', 'request_id': 'req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.513427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdb080ddf534838957b4981d75716c7', 'request_id': 'req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.527342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] The token cache is being invalidate because project ebdb080ddf534838957b4981d75716c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:15.527835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.528742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.530586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 991/2009] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:15 2022] DELETE /identity/v3/projects/ebdb080ddf534838957b4981d75716c7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:15.535381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f141ac3-71dd-49a9-b129-85c38a1c0042 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:15.550468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f141ac3-71dd-49a9-b129-85c38a1c0042 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:15.594113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:15.595690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:15.613570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:15.625846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:15.626632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:15.627604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:15.627942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:15.628369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] PATH_INFO: `/v3/users/bbea45ee81d54858b866a7bff1c25a2e` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:15.629588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbea45ee81d54858b866a7bff1c25a2e)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:15.631886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:15.672948 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8670ccc-3bba-4422-bbbe-b5cb988bfe88 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:15.678418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:15.679066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:15.679355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:15.679637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] PATH_INFO: `/v3/projects/c1c3806ba0f04e11aa247c7459a7f865` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:15.680847 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c3806ba0f04e11aa247c7459a7f865)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:15.682820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:15.689327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbea45ee81d54858b866a7bff1c25a2e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.690590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbea45ee81d54858b866a7bff1c25a2e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.691214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbea45ee81d54858b866a7bff1c25a2e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.700169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbea45ee81d54858b866a7bff1c25a2e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.713133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ce67e894-288b-4417-9c48-76e29ca6801b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbea45ee81d54858b866a7bff1c25a2e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.729528 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1019/2010] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:15 2022] DELETE /identity/v3/users/bbea45ee81d54858b866a7bff1c25a2e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:15.742097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c3806ba0f04e11aa247c7459a7f865', 'request_id': 'req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.750013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c3806ba0f04e11aa247c7459a7f865', 'request_id': 'req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.769551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c3806ba0f04e11aa247c7459a7f865', 'request_id': 'req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.781509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] The token cache is being invalidate because project c1c3806ba0f04e11aa247c7459a7f865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:15.781859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.782485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-55d3eb34-14a9-4cf8-bb76-8bd1d096f040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:15.787671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 992/2011] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:15 2022] DELETE /identity/v3/projects/c1c3806ba0f04e11aa247c7459a7f865 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:15.789441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed3fd3-2e40-45bc-ad45-4cbb06d3a029 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:15.789742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed3fd3-2e40-45bc-ad45-4cbb06d3a029 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:15.790038 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed3fd3-2e40-45bc-ad45-4cbb06d3a029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:15.810693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5aed3fd3-2e40-45bc-ad45-4cbb06d3a029 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:15.811995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5aed3fd3-2e40-45bc-ad45-4cbb06d3a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:15.881579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1020/2012] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:15.889913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d280ae-c658-4b76-b14a-a14aed2fc027 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:15.890215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d280ae-c658-4b76-b14a-a14aed2fc027 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:15.890531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d280ae-c658-4b76-b14a-a14aed2fc027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:15.912954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-77d280ae-c658-4b76-b14a-a14aed2fc027 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:15.914183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-77d280ae-c658-4b76-b14a-a14aed2fc027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:15.922718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 993/2013] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:28:15.927526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed3fd3-2e40-45bc-ad45-4cbb06d3a029 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:15.937693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed3fd3-2e40-45bc-ad45-4cbb06d3a029 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:15.942387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa5375-01f2-49e2-a5a5-27fa1ab41ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:15.943092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa5375-01f2-49e2-a5a5-27fa1ab41ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:15.943258 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa5375-01f2-49e2-a5a5-27fa1ab41ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:15.943524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa5375-01f2-49e2-a5a5-27fa1ab41ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:15.944179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa5375-01f2-49e2-a5a5-27fa1ab41ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:28:15.944531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa5375-01f2-49e2-a5a5-27fa1ab41ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:15.946136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa5375-01f2-49e2-a5a5-27fa1ab41ab6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:15.958212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1021/2014] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:28:15.962620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d280ae-c658-4b76-b14a-a14aed2fc027 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:15.973546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d280ae-c658-4b76-b14a-a14aed2fc027 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:15.979190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21529623-4d92-4eea-b871-384f8945ab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:15.980021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21529623-4d92-4eea-b871-384f8945ab48 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:15.980488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21529623-4d92-4eea-b871-384f8945ab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:15.980735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21529623-4d92-4eea-b871-384f8945ab48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:15.981451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21529623-4d92-4eea-b871-384f8945ab48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:15.983630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21529623-4d92-4eea-b871-384f8945ab48 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.022266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 994/2015] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:15 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:16.025302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa5375-01f2-49e2-a5a5-27fa1ab41ab6 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.036702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa5375-01f2-49e2-a5a5-27fa1ab41ab6 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.039904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21529623-4d92-4eea-b871-384f8945ab48 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.041656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-21529623-4d92-4eea-b871-384f8945ab48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:16.141125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21529623-4d92-4eea-b871-384f8945ab48 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.144476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:16.146009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.146702 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.147092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.147366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] PATH_INFO: `/v3/users/5a7a9cb361db4034ad33d74c887b767d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.148607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7a9cb361db4034ad33d74c887b767d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.150714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.155869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7562f-72f0-4b01-8115-adf53ce22972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.156780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7562f-72f0-4b01-8115-adf53ce22972 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.157569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7562f-72f0-4b01-8115-adf53ce22972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.158580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7562f-72f0-4b01-8115-adf53ce22972 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.158580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7562f-72f0-4b01-8115-adf53ce22972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.160808 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7562f-72f0-4b01-8115-adf53ce22972 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.183434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:16.188224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1022/2016] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:16 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:16.189170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7562f-72f0-4b01-8115-adf53ce22972 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.192698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-bdf7562f-72f0-4b01-8115-adf53ce22972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:16.206934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7562f-72f0-4b01-8115-adf53ce22972 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.210210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7a9cb361db4034ad33d74c887b767d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:16.211587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7a9cb361db4034ad33d74c887b767d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:16.212889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.213738 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.214084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.214463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] PATH_INFO: `/v3/projects/fb30413082c6491381fb4e1c13b0979b` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.215721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb30413082c6491381fb4e1c13b0979b)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.219923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.221043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7a9cb361db4034ad33d74c887b767d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:16.239591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7a9cb361db4034ad33d74c887b767d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:16.241322 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7a9cb361db4034ad33d74c887b767d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:16.257928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 995/2017] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:16 2022] DELETE /identity/v3/users/5a7a9cb361db4034ad33d74c887b767d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:16.258772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.260267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:16.282684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb30413082c6491381fb4e1c13b0979b', 'request_id': 'req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:16.289780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb30413082c6491381fb4e1c13b0979b', 'request_id': 'req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:16.295804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb30413082c6491381fb4e1c13b0979b', 'request_id': 'req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:16.312294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] The token cache is being invalidate because project fb30413082c6491381fb4e1c13b0979b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:16.312621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:16.313305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f71710c4-bb1a-4b42-8ee6-439ddb45a91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:16.315117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1023/2018] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:16 2022] DELETE /identity/v3/projects/fb30413082c6491381fb4e1c13b0979b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:16.316345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf07f-5df4-4deb-baa6-a583e927d847 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.316655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf07f-5df4-4deb-baa6-a583e927d847 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.316925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf07f-5df4-4deb-baa6-a583e927d847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.336340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ccaaf07f-5df4-4deb-baa6-a583e927d847 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:16.337877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ccaaf07f-5df4-4deb-baa6-a583e927d847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:16.339165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25469945-d19e-4fd3-9b13-1147343ccf97 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.412253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef42d9-ecbf-454d-b3c0-d74a5dc87b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.412964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef42d9-ecbf-454d-b3c0-d74a5dc87b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.413171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef42d9-ecbf-454d-b3c0-d74a5dc87b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.413507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef42d9-ecbf-454d-b3c0-d74a5dc87b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.414088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef42d9-ecbf-454d-b3c0-d74a5dc87b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.417444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1024/2019] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:16.417542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef42d9-ecbf-454d-b3c0-d74a5dc87b90 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.417638 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042e59-3a36-42ca-9fac-7728a67e2547 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.417638 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042e59-3a36-42ca-9fac-7728a67e2547 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.417638 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042e59-3a36-42ca-9fac-7728a67e2547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.435991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 996/2020] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:16.435991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef42d9-ecbf-454d-b3c0-d74a5dc87b90 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.437641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-21042e59-3a36-42ca-9fac-7728a67e2547 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:16.437781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-65ef42d9-ecbf-454d-b3c0-d74a5dc87b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:16.438515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-21042e59-3a36-42ca-9fac-7728a67e2547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:16.455521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1025/2021] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:16.456829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042e59-3a36-42ca-9fac-7728a67e2547 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.458653 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-21042e59-3a36-42ca-9fac-7728a67e2547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:16.473755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042e59-3a36-42ca-9fac-7728a67e2547 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.481800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b058d0f-a6ba-4d7f-a17c-c0c97b99b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.483274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b058d0f-a6ba-4d7f-a17c-c0c97b99b143 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.483824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b058d0f-a6ba-4d7f-a17c-c0c97b99b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.483960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b058d0f-a6ba-4d7f-a17c-c0c97b99b143 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.484638 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b058d0f-a6ba-4d7f-a17c-c0c97b99b143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.486369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b058d0f-a6ba-4d7f-a17c-c0c97b99b143 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.501311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1026/2022] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:16.501311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4332c-7f0b-43e2-b7e9-9ae09eac0157 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.501311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4332c-7f0b-43e2-b7e9-9ae09eac0157 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.501311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4332c-7f0b-43e2-b7e9-9ae09eac0157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.506236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:16.511616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef42d9-ecbf-454d-b3c0-d74a5dc87b90 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.518646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e555fe1-ea48-43ad-bccb-846f32bf6a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.519398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e555fe1-ea48-43ad-bccb-846f32bf6a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.519782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e555fe1-ea48-43ad-bccb-846f32bf6a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.520227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e555fe1-ea48-43ad-bccb-846f32bf6a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.523497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0ac4332c-7f0b-43e2-b7e9-9ae09eac0157 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:16.524800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0ac4332c-7f0b-43e2-b7e9-9ae09eac0157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:16.531387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e555fe1-ea48-43ad-bccb-846f32bf6a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.532987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e555fe1-ea48-43ad-bccb-846f32bf6a5b service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.540421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1027/2023] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:16.544165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 997/2024] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:16.544572 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4332c-7f0b-43e2-b7e9-9ae09eac0157 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.545774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e555fe1-ea48-43ad-bccb-846f32bf6a5b service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.560286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4332c-7f0b-43e2-b7e9-9ae09eac0157 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.565777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcac95-a590-4ab2-a215-e9e4a8cc529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.566470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcac95-a590-4ab2-a215-e9e4a8cc529b admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.566749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcac95-a590-4ab2-a215-e9e4a8cc529b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.567021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcac95-a590-4ab2-a215-e9e4a8cc529b admin admin] PATH_INFO: `/v3/projects/c85be1765393416c92df2787ec0e62a7/users/63ab5a2b9ffe4a8199678d9cc7fe51f4/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.567129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e555fe1-ea48-43ad-bccb-846f32bf6a5b service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.580417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a8bf-62d2-443f-9e0a-c3394feddb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.581148 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a8bf-62d2-443f-9e0a-c3394feddb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.581538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a8bf-62d2-443f-9e0a-c3394feddb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.581882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a8bf-62d2-443f-9e0a-c3394feddb57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.582608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a8bf-62d2-443f-9e0a-c3394feddb57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:28:16.582983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a8bf-62d2-443f-9e0a-c3394feddb57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.584696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a8bf-62d2-443f-9e0a-c3394feddb57 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.587632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcac95-a590-4ab2-a215-e9e4a8cc529b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85be1765393416c92df2787ec0e62a7, user_id=63ab5a2b9ffe4a8199678d9cc7fe51f4, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.594309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcac95-a590-4ab2-a215-e9e4a8cc529b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.604376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 998/2025] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:28:16.605500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a8bf-62d2-443f-9e0a-c3394feddb57 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.625755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1028/2026] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:16 2022] PUT /identity/v3/projects/c85be1765393416c92df2787ec0e62a7/users/63ab5a2b9ffe4a8199678d9cc7fe51f4/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:16.625973 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a8bf-62d2-443f-9e0a-c3394feddb57 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.629624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939850ef-9892-465a-84a3-4c5fd57d5d5a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.630163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939850ef-9892-465a-84a3-4c5fd57d5d5a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.630786 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939850ef-9892-465a-84a3-4c5fd57d5d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.664606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-939850ef-9892-465a-84a3-4c5fd57d5d5a None None] MFA Rules not processed for user `63ab5a2b9ffe4a8199678d9cc7fe51f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:16.665824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-939850ef-9892-465a-84a3-4c5fd57d5d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:16.673116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:16.725778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439fdde-d8f9-475c-a484-a72e8f9d0995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.726535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439fdde-d8f9-475c-a484-a72e8f9d0995 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.726977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439fdde-d8f9-475c-a484-a72e8f9d0995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.727324 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439fdde-d8f9-475c-a484-a72e8f9d0995 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.728092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439fdde-d8f9-475c-a484-a72e8f9d0995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.730664 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439fdde-d8f9-475c-a484-a72e8f9d0995 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.751067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1029/2027] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:28:16.768903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939850ef-9892-465a-84a3-4c5fd57d5d5a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.773524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-939850ef-9892-465a-84a3-4c5fd57d5d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:16.791081 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 999/2028] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:16 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:28:16.792013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439fdde-d8f9-475c-a484-a72e8f9d0995 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.886321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439fdde-d8f9-475c-a484-a72e8f9d0995 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.892919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939850ef-9892-465a-84a3-4c5fd57d5d5a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.894962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cda71-d560-440f-9059-2406c7b0ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.895881 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cda71-d560-440f-9059-2406c7b0ab38 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.896339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cda71-d560-440f-9059-2406c7b0ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.896830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cda71-d560-440f-9059-2406c7b0ab38 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.897761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cda71-d560-440f-9059-2406c7b0ab38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.900147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cda71-d560-440f-9059-2406c7b0ab38 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.929021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1000/2029] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:16 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:16.932959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cda71-d560-440f-9059-2406c7b0ab38 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.948676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cda71-d560-440f-9059-2406c7b0ab38 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.950827 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41c006-ab40-4768-8efc-9180a9f0c764 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f83a7e0c14541788c92e3d96b839077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.951683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41c006-ab40-4768-8efc-9180a9f0c764 service glance] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.952056 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41c006-ab40-4768-8efc-9180a9f0c764 service glance] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.952327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41c006-ab40-4768-8efc-9180a9f0c764 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.954540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc423ec5-5b46-4540-9404-e0b52920da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.955143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc423ec5-5b46-4540-9404-e0b52920da0a admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.955509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc423ec5-5b46-4540-9404-e0b52920da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.955707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc423ec5-5b46-4540-9404-e0b52920da0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.956368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc423ec5-5b46-4540-9404-e0b52920da0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.958424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc423ec5-5b46-4540-9404-e0b52920da0a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:16.972786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1001/2030] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:16.976723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc423ec5-5b46-4540-9404-e0b52920da0a admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:16.987965 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc423ec5-5b46-4540-9404-e0b52920da0a admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:16.993808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30ff9-2248-4da4-964f-a561cd92acc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:16.994558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30ff9-2248-4da4-964f-a561cd92acc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:16.994840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30ff9-2248-4da4-964f-a561cd92acc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:16.995119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30ff9-2248-4da4-964f-a561cd92acc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:16.995769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef30ff9-2248-4da4-964f-a561cd92acc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:16.997614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef30ff9-2248-4da4-964f-a561cd92acc6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:17.009455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1002/2031] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:17.013963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30ff9-2248-4da4-964f-a561cd92acc6 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:17.023822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41c006-ab40-4768-8efc-9180a9f0c764 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:17.025078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30ff9-2248-4da4-964f-a561cd92acc6 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:17.025983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41c006-ab40-4768-8efc-9180a9f0c764 service glance] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:17.030116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e358e2a-e974-4664-a834-3248175cea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:17.031181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358e2a-e974-4664-a834-3248175cea52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:17.031471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358e2a-e974-4664-a834-3248175cea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:17.031760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358e2a-e974-4664-a834-3248175cea52 admin admin] PATH_INFO: `/v3/projects/8e54a265193f4ff597467d5f35f455bd/users/82df09e6c0304d948b74ad8ddcefe476/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:17.031880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:17.040900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1030/2032] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:17.049031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e358e2a-e974-4664-a834-3248175cea52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e54a265193f4ff597467d5f35f455bd, user_id=82df09e6c0304d948b74ad8ddcefe476, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:17.052627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e358e2a-e974-4664-a834-3248175cea52 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:17.070060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1003/2033] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:17 2022] PUT /identity/v3/projects/8e54a265193f4ff597467d5f35f455bd/users/82df09e6c0304d948b74ad8ddcefe476/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:17.088750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c2ad-c486-40ec-a0f6-03d279cd9300 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:17.089034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c2ad-c486-40ec-a0f6-03d279cd9300 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:17.089315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c2ad-c486-40ec-a0f6-03d279cd9300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:17.109059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e358e2a-e974-4664-a834-3248175cea52 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:17.111261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0e358e2a-e974-4664-a834-3248175cea52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:17.121697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:17.148140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1cd2c2ad-c486-40ec-a0f6-03d279cd9300 None None] MFA Rules not processed for user `82df09e6c0304d948b74ad8ddcefe476`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:17.150404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1cd2c2ad-c486-40ec-a0f6-03d279cd9300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:17.190884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e358e2a-e974-4664-a834-3248175cea52 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:17.195708 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:17.196335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:17.196679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:17.196945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] PATH_INFO: `/v3/projects/8e7b896f5a59470c923e3e431f66b0bd` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:17.198089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7b896f5a59470c923e3e431f66b0bd)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:17.200432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:17.226105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1031/2034] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:17.230678 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2c2ad-c486-40ec-a0f6-03d279cd9300 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:17.246568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2c2ad-c486-40ec-a0f6-03d279cd9300 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:17.256727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7b896f5a59470c923e3e431f66b0bd', 'request_id': 'req-f5299559-0362-4871-9470-829805e6c2ba'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:17.265125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7b896f5a59470c923e3e431f66b0bd', 'request_id': 'req-f5299559-0362-4871-9470-829805e6c2ba'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:17.282161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7b896f5a59470c923e3e431f66b0bd', 'request_id': 'req-f5299559-0362-4871-9470-829805e6c2ba'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:17.298512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] The token cache is being invalidate because project 8e7b896f5a59470c923e3e431f66b0bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:17.298816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:17.299507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:17.301311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1004/2035] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:17 2022] DELETE /identity/v3/projects/8e7b896f5a59470c923e3e431f66b0bd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:17.305277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:17.306767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:17.334699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0f067-c660-428e-9b57-c634d64da08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:17.335470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0f067-c660-428e-9b57-c634d64da08e admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:17.336312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0f067-c660-428e-9b57-c634d64da08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:17.336852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0f067-c660-428e-9b57-c634d64da08e admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:17.337600 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0f067-c660-428e-9b57-c634d64da08e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:17.339964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0f067-c660-428e-9b57-c634d64da08e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:17.384608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1032/2036] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:17 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:28:17.387297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0f067-c660-428e-9b57-c634d64da08e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:17.389579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4cb0f067-c660-428e-9b57-c634d64da08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:17.389706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5299559-0362-4871-9470-829805e6c2ba admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:17.444628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:17.471931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:17.473039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:17.473390 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:17.473855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] PATH_INFO: `/v3/users/53f01b3c1f244e3184ecc6f179fef5b9` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:17.475119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f01b3c1f244e3184ecc6f179fef5b9)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:17.477500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:17.479835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0f067-c660-428e-9b57-c634d64da08e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:17.487980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c515cb-b381-42fc-8853-e5b74e03ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:17.488978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c515cb-b381-42fc-8853-e5b74e03ddf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:17.489271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c515cb-b381-42fc-8853-e5b74e03ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:17.489492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c515cb-b381-42fc-8853-e5b74e03ddf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:17.490228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c515cb-b381-42fc-8853-e5b74e03ddf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:17.492756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c515cb-b381-42fc-8853-e5b74e03ddf1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:17.518688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1033/2037] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:17 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:28:17.522716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c515cb-b381-42fc-8853-e5b74e03ddf1 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:17.528448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:17.536461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c515cb-b381-42fc-8853-e5b74e03ddf1 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:17.542359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19c441-70ac-481a-994f-8af4eb318169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:17.543852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19c441-70ac-481a-994f-8af4eb318169 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:17.544514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19c441-70ac-481a-994f-8af4eb318169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:17.544887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19c441-70ac-481a-994f-8af4eb318169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:17.545607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19c441-70ac-481a-994f-8af4eb318169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:17.546280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f01b3c1f244e3184ecc6f179fef5b9'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:17.547049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f01b3c1f244e3184ecc6f179fef5b9'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:17.547547 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19c441-70ac-481a-994f-8af4eb318169 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:17.554874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f01b3c1f244e3184ecc6f179fef5b9'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:17.558933 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1034/2038] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:17.563167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19c441-70ac-481a-994f-8af4eb318169 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:17.564975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9d19c441-70ac-481a-994f-8af4eb318169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:17.570259 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f01b3c1f244e3184ecc6f179fef5b9'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:17.570982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f01b3c1f244e3184ecc6f179fef5b9'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:17.579557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19c441-70ac-481a-994f-8af4eb318169 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:17.585048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f65da-1842-4ff0-b824-f609d2480fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:17.585659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f65da-1842-4ff0-b824-f609d2480fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:17.585934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f65da-1842-4ff0-b824-f609d2480fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:17.586201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f65da-1842-4ff0-b824-f609d2480fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:17.586847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f65da-1842-4ff0-b824-f609d2480fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:17.588492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f65da-1842-4ff0-b824-f609d2480fa5 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:17.597983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1005/2039] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:17 2022] DELETE /identity/v3/users/53f01b3c1f244e3184ecc6f179fef5b9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:17.620226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1035/2040] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:17.621431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:17.713963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c44a44-a841-427e-9bf4-8253d4c503b7 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:17.719404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12448f3d-6e00-4aae-84f5-456de851f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:17.720206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12448f3d-6e00-4aae-84f5-456de851f2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:17.720518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12448f3d-6e00-4aae-84f5-456de851f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:17.720826 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12448f3d-6e00-4aae-84f5-456de851f2ea admin admin] PATH_INFO: `/v3/projects/d48e668c596c42259fdc7da956c3364a/users/4a8c1a9b195e4e1db71cd039984d66e8/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:17.737385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12448f3d-6e00-4aae-84f5-456de851f2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48e668c596c42259fdc7da956c3364a, user_id=4a8c1a9b195e4e1db71cd039984d66e8, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:17.740033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12448f3d-6e00-4aae-84f5-456de851f2ea admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:17.760486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1006/2041] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:17 2022] PUT /identity/v3/projects/d48e668c596c42259fdc7da956c3364a/users/4a8c1a9b195e4e1db71cd039984d66e8/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:17.766376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce3bd9-36fd-4de6-a02b-789fe80a07f5 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:17.766376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce3bd9-36fd-4de6-a02b-789fe80a07f5 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:17.766376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce3bd9-36fd-4de6-a02b-789fe80a07f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:17.796428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-94ce3bd9-36fd-4de6-a02b-789fe80a07f5 None None] MFA Rules not processed for user `4a8c1a9b195e4e1db71cd039984d66e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:17.797713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-94ce3bd9-36fd-4de6-a02b-789fe80a07f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:17.894409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1036/2042] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:28:17.900867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12448f3d-6e00-4aae-84f5-456de851f2ea admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:17.940624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce3bd9-36fd-4de6-a02b-789fe80a07f5 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:17.942765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-94ce3bd9-36fd-4de6-a02b-789fe80a07f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:18.006188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:18.038186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12448f3d-6e00-4aae-84f5-456de851f2ea admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.043122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca948b-4cf5-44d1-852c-a567b7adcd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.043745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca948b-4cf5-44d1-852c-a567b7adcd2d admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.044088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca948b-4cf5-44d1-852c-a567b7adcd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.044370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca948b-4cf5-44d1-852c-a567b7adcd2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.045050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca948b-4cf5-44d1-852c-a567b7adcd2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.046974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca948b-4cf5-44d1-852c-a567b7adcd2d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.076641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1007/2043] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:17 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:28:18.082024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca948b-4cf5-44d1-852c-a567b7adcd2d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.096980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce3bd9-36fd-4de6-a02b-789fe80a07f5 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.153275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca948b-4cf5-44d1-852c-a567b7adcd2d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.158661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406a534-5601-4ad8-9e98-c31036042b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.159280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406a534-5601-4ad8-9e98-c31036042b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.159559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406a534-5601-4ad8-9e98-c31036042b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.159861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406a534-5601-4ad8-9e98-c31036042b36 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.159963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.160531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406a534-5601-4ad8-9e98-c31036042b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.160633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.160899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.161225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] PATH_INFO: `/v3/projects/3d5a84e9b23e45af89673aee43427d8a` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.162279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5a84e9b23e45af89673aee43427d8a)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.162634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406a534-5601-4ad8-9e98-c31036042b36 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.164197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.190904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1008/2044] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:18 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:28:18.196192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406a534-5601-4ad8-9e98-c31036042b36 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.197190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:18.209116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406a534-5601-4ad8-9e98-c31036042b36 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.214920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe717b2-97a9-41ae-8473-680002903352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.215573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe717b2-97a9-41ae-8473-680002903352 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.215860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe717b2-97a9-41ae-8473-680002903352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.216136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe717b2-97a9-41ae-8473-680002903352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.216823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe717b2-97a9-41ae-8473-680002903352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.218734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe717b2-97a9-41ae-8473-680002903352 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.226084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5a84e9b23e45af89673aee43427d8a', 'request_id': 'req-49071098-0dc7-442b-89c7-04ab99f2d0af'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.229952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1009/2045] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:18.234374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe717b2-97a9-41ae-8473-680002903352 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.235681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5a84e9b23e45af89673aee43427d8a', 'request_id': 'req-49071098-0dc7-442b-89c7-04ab99f2d0af'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.243311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5a84e9b23e45af89673aee43427d8a', 'request_id': 'req-49071098-0dc7-442b-89c7-04ab99f2d0af'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.245750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe717b2-97a9-41ae-8473-680002903352 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.259756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] The token cache is being invalidate because project 3d5a84e9b23e45af89673aee43427d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:18.260355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.261411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.263904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1037/2046] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:17 2022] DELETE /identity/v3/projects/3d5a84e9b23e45af89673aee43427d8a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:18.267872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.269393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:18.320114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd348bf-be8e-4c5d-9a7a-e78eb344f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.320798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd348bf-be8e-4c5d-9a7a-e78eb344f6da admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.321079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd348bf-be8e-4c5d-9a7a-e78eb344f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.321388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd348bf-be8e-4c5d-9a7a-e78eb344f6da admin admin] PATH_INFO: `/v3/projects/1c6b3af96f4a4b899f9abd9534a9b1f6/users/dc0dd8d801a649b6a0f0c0ab2832c0e4/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.337864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd348bf-be8e-4c5d-9a7a-e78eb344f6da admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6b3af96f4a4b899f9abd9534a9b1f6, user_id=dc0dd8d801a649b6a0f0c0ab2832c0e4, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.340763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd348bf-be8e-4c5d-9a7a-e78eb344f6da admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.340942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49071098-0dc7-442b-89c7-04ab99f2d0af admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.345981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.347008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.347299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.347577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] PATH_INFO: `/v3/users/681b30a21e174cb6936c0213db5ce5b2` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.349019 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=681b30a21e174cb6936c0213db5ce5b2)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.351036 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.355568 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1010/2047] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:18 2022] PUT /identity/v3/projects/1c6b3af96f4a4b899f9abd9534a9b1f6/users/dc0dd8d801a649b6a0f0c0ab2832c0e4/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:18.359725 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd348bf-be8e-4c5d-9a7a-e78eb344f6da admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.361631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-bdd348bf-be8e-4c5d-9a7a-e78eb344f6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:18.398560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:18.401106 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681b30a21e174cb6936c0213db5ce5b2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.402085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681b30a21e174cb6936c0213db5ce5b2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.402839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681b30a21e174cb6936c0213db5ce5b2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.411200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681b30a21e174cb6936c0213db5ce5b2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.425097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681b30a21e174cb6936c0213db5ce5b2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.433724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd348bf-be8e-4c5d-9a7a-e78eb344f6da admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.439319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62704a8d-3d41-4649-97ad-d91dacf571c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.439942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62704a8d-3d41-4649-97ad-d91dacf571c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.440222 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62704a8d-3d41-4649-97ad-d91dacf571c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.440652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1038/2048] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:18 2022] DELETE /identity/v3/users/681b30a21e174cb6936c0213db5ce5b2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:18.440762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62704a8d-3d41-4649-97ad-d91dacf571c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.441176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62704a8d-3d41-4649-97ad-d91dacf571c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.442793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62704a8d-3d41-4649-97ad-d91dacf571c9 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.453782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1011/2049] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:18.458053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.459411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:18.492698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:18.541470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd01297-93db-4e09-bc04-4d4314e337ef admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.547145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cda88d-50e4-4690-8716-09d72823a0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.547827 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cda88d-50e4-4690-8716-09d72823a0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.548116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cda88d-50e4-4690-8716-09d72823a0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.548404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cda88d-50e4-4690-8716-09d72823a0d3 admin admin] PATH_INFO: `/v3/projects/1c6b3af96f4a4b899f9abd9534a9b1f6/users/dc0dd8d801a649b6a0f0c0ab2832c0e4/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.550575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cda88d-50e4-4690-8716-09d72823a0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6b3af96f4a4b899f9abd9534a9b1f6, user_id=dc0dd8d801a649b6a0f0c0ab2832c0e4, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.553447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cda88d-50e4-4690-8716-09d72823a0d3 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.564612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1039/2050] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:18 2022] PUT /identity/v3/projects/1c6b3af96f4a4b899f9abd9534a9b1f6/users/dc0dd8d801a649b6a0f0c0ab2832c0e4/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:18.577554 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d9b68-a0c7-4ea3-8b54-4176b7c1aa65 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.577846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d9b68-a0c7-4ea3-8b54-4176b7c1aa65 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.578125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d9b68-a0c7-4ea3-8b54-4176b7c1aa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.608213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6b1d9b68-a0c7-4ea3-8b54-4176b7c1aa65 None None] MFA Rules not processed for user `dc0dd8d801a649b6a0f0c0ab2832c0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:18.609503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6b1d9b68-a0c7-4ea3-8b54-4176b7c1aa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:18.685919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1012/2051] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:18.698806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cda88d-50e4-4690-8716-09d72823a0d3 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.701147 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-10cda88d-50e4-4690-8716-09d72823a0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:18.777870 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cda88d-50e4-4690-8716-09d72823a0d3 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.781859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c16f52-f9c0-48f2-acf7-9c8d0d12f964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.782475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c16f52-f9c0-48f2-acf7-9c8d0d12f964 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.782758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c16f52-f9c0-48f2-acf7-9c8d0d12f964 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.783823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c16f52-f9c0-48f2-acf7-9c8d0d12f964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.785010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-69c16f52-f9c0-48f2-acf7-9c8d0d12f964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:18.853359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c16f52-f9c0-48f2-acf7-9c8d0d12f964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.854823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c16f52-f9c0-48f2-acf7-9c8d0d12f964 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.866083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1040/2052] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:28:18.996481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d9b68-a0c7-4ea3-8b54-4176b7c1aa65 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.998329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6b1d9b68-a0c7-4ea3-8b54-4176b7c1aa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:19.075227 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d9b68-a0c7-4ea3-8b54-4176b7c1aa65 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.080009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.080695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.080984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.081278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] PATH_INFO: `/v3/projects/c79b16a040444ef2a4f30630e4e38407` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.082521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79b16a040444ef2a4f30630e4e38407)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.084532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.147302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79b16a040444ef2a4f30630e4e38407', 'request_id': 'req-d5e9830f-d0b2-460e-b824-fb8bc620226b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.156080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79b16a040444ef2a4f30630e4e38407', 'request_id': 'req-d5e9830f-d0b2-460e-b824-fb8bc620226b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.158711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:19.170172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79b16a040444ef2a4f30630e4e38407', 'request_id': 'req-d5e9830f-d0b2-460e-b824-fb8bc620226b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.183705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] The token cache is being invalidate because project c79b16a040444ef2a4f30630e4e38407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:19.184066 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.184837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d5e9830f-d0b2-460e-b824-fb8bc620226b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.190680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1013/2053] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:18 2022] DELETE /identity/v3/projects/c79b16a040444ef2a4f30630e4e38407 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:19.192690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453ab14-1e0d-4d51-94cf-d6b2b2bb1129 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.193206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453ab14-1e0d-4d51-94cf-d6b2b2bb1129 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.193585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453ab14-1e0d-4d51-94cf-d6b2b2bb1129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.230034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-9453ab14-1e0d-4d51-94cf-d6b2b2bb1129 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:19.234309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9453ab14-1e0d-4d51-94cf-d6b2b2bb1129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:19.306133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1041/2054] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:19.313624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578adde-66a0-4fcd-a5be-d9a3ab298abd None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.313624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578adde-66a0-4fcd-a5be-d9a3ab298abd None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.313624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578adde-66a0-4fcd-a5be-d9a3ab298abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.348459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-8578adde-66a0-4fcd-a5be-d9a3ab298abd None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:19.348459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8578adde-66a0-4fcd-a5be-d9a3ab298abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:19.354563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1014/2055] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:19.359393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453ab14-1e0d-4d51-94cf-d6b2b2bb1129 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.372978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453ab14-1e0d-4d51-94cf-d6b2b2bb1129 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.378405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0958b-11e8-4040-bb58-018f92cd9bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.379031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0958b-11e8-4040-bb58-018f92cd9bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.379456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0958b-11e8-4040-bb58-018f92cd9bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.379734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0958b-11e8-4040-bb58-018f92cd9bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.380412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0958b-11e8-4040-bb58-018f92cd9bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:28:19.380750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0958b-11e8-4040-bb58-018f92cd9bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.382530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0958b-11e8-4040-bb58-018f92cd9bc5 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.395329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1042/2056] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:28:19.399820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578adde-66a0-4fcd-a5be-d9a3ab298abd None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.409303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578adde-66a0-4fcd-a5be-d9a3ab298abd None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.413885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe37a6a-8fec-4940-83b7-1c13ef170c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.414489 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe37a6a-8fec-4940-83b7-1c13ef170c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.414841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe37a6a-8fec-4940-83b7-1c13ef170c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.415030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe37a6a-8fec-4940-83b7-1c13ef170c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.415663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe37a6a-8fec-4940-83b7-1c13ef170c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.417592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe37a6a-8fec-4940-83b7-1c13ef170c89 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.452643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1015/2057] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:19 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:19.454041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0958b-11e8-4040-bb58-018f92cd9bc5 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.459344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:19.465898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0958b-11e8-4040-bb58-018f92cd9bc5 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.523550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4513c-a0c6-426e-be2e-e8d35ea3b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.524167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4513c-a0c6-426e-be2e-e8d35ea3b344 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.524479 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4513c-a0c6-426e-be2e-e8d35ea3b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.524753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4513c-a0c6-426e-be2e-e8d35ea3b344 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.525378 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4513c-a0c6-426e-be2e-e8d35ea3b344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.527356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4513c-a0c6-426e-be2e-e8d35ea3b344 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.550795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1043/2058] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:19 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:19.555064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe37a6a-8fec-4940-83b7-1c13ef170c89 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.566030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe37a6a-8fec-4940-83b7-1c13ef170c89 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.571234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6502f-4359-406e-8fb3-7effa9334551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.571866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6502f-4359-406e-8fb3-7effa9334551 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.572141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6502f-4359-406e-8fb3-7effa9334551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.572437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6502f-4359-406e-8fb3-7effa9334551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.573085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6502f-4359-406e-8fb3-7effa9334551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.574691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6502f-4359-406e-8fb3-7effa9334551 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.585560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1016/2059] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:19.589715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4513c-a0c6-426e-be2e-e8d35ea3b344 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.600623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4513c-a0c6-426e-be2e-e8d35ea3b344 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.606992 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9532e6-9183-4d7c-b0b0-73134bd91096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.607604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9532e6-9183-4d7c-b0b0-73134bd91096 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.607918 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9532e6-9183-4d7c-b0b0-73134bd91096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.608153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9532e6-9183-4d7c-b0b0-73134bd91096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.608864 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9532e6-9183-4d7c-b0b0-73134bd91096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.610496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9532e6-9183-4d7c-b0b0-73134bd91096 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.622458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1044/2060] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:19.626756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6502f-4359-406e-8fb3-7effa9334551 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.637257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6502f-4359-406e-8fb3-7effa9334551 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.642348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb20d78-ca82-4ed1-aee0-f0ab57782d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.643000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb20d78-ca82-4ed1-aee0-f0ab57782d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.643270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb20d78-ca82-4ed1-aee0-f0ab57782d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.643538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb20d78-ca82-4ed1-aee0-f0ab57782d7b admin admin] PATH_INFO: `/v3/projects/e6704532ce49478ea5ca1be3a8fd31ba/users/c08db26d8866490fa83b373d65f722db/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.658672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb20d78-ca82-4ed1-aee0-f0ab57782d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6704532ce49478ea5ca1be3a8fd31ba, user_id=c08db26d8866490fa83b373d65f722db, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.661661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb20d78-ca82-4ed1-aee0-f0ab57782d7b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.676913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1017/2061] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:19 2022] PUT /identity/v3/projects/e6704532ce49478ea5ca1be3a8fd31ba/users/c08db26d8866490fa83b373d65f722db/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:19.687478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322e811-776d-4a72-9af8-ab3276e11309 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.687778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322e811-776d-4a72-9af8-ab3276e11309 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.688039 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322e811-776d-4a72-9af8-ab3276e11309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.722547 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-7322e811-776d-4a72-9af8-ab3276e11309 None None] MFA Rules not processed for user `c08db26d8866490fa83b373d65f722db`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:19.723780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7322e811-776d-4a72-9af8-ab3276e11309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:19.799278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1045/2062] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:19.810612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb20d78-ca82-4ed1-aee0-f0ab57782d7b admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.812647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0eb20d78-ca82-4ed1-aee0-f0ab57782d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:19.877309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb20d78-ca82-4ed1-aee0-f0ab57782d7b admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.881207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4e058-a0fe-4ec7-a495-0db7ad95473c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.881828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e058-a0fe-4ec7-a495-0db7ad95473c service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.882108 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e058-a0fe-4ec7-a495-0db7ad95473c service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.891305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e058-a0fe-4ec7-a495-0db7ad95473c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.902129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4e058-a0fe-4ec7-a495-0db7ad95473c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.904147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4e058-a0fe-4ec7-a495-0db7ad95473c service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.914767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1018/2063] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:28:21.633371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322e811-776d-4a72-9af8-ab3276e11309 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:21.646521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322e811-776d-4a72-9af8-ab3276e11309 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:21.650432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861ffc-3cfd-4df6-b9c0-c467228e05b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:21.651144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861ffc-3cfd-4df6-b9c0-c467228e05b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:21.651531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861ffc-3cfd-4df6-b9c0-c467228e05b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:21.651884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861ffc-3cfd-4df6-b9c0-c467228e05b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:21.653954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a6861ffc-3cfd-4df6-b9c0-c467228e05b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:21.729475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6861ffc-3cfd-4df6-b9c0-c467228e05b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:21.731390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6861ffc-3cfd-4df6-b9c0-c467228e05b8 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:21.742309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1046/2064] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:28:22.361646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4e058-a0fe-4ec7-a495-0db7ad95473c service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:22.370379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4e058-a0fe-4ec7-a495-0db7ad95473c service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:22.374679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821eca7-b56e-4673-8db1-788de8070db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:22.375567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821eca7-b56e-4673-8db1-788de8070db0 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.375567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821eca7-b56e-4673-8db1-788de8070db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.375567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821eca7-b56e-4673-8db1-788de8070db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:22.378133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5821eca7-b56e-4673-8db1-788de8070db0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:22.445749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821eca7-b56e-4673-8db1-788de8070db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:22.447189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821eca7-b56e-4673-8db1-788de8070db0 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:22.457827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1019/2065] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:31.737627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:32.452852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=87 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:33.949063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861ffc-3cfd-4df6-b9c0-c467228e05b8 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:33.950510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a6861ffc-3cfd-4df6-b9c0-c467228e05b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:34.019448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861ffc-3cfd-4df6-b9c0-c467228e05b8 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:34.024078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:34.024754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:34.025036 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:34.025310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] PATH_INFO: `/v3/users/82df09e6c0304d948b74ad8ddcefe476` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:34.026451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82df09e6c0304d948b74ad8ddcefe476)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:34.028429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:34.084174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82df09e6c0304d948b74ad8ddcefe476'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.084990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82df09e6c0304d948b74ad8ddcefe476'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.085688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82df09e6c0304d948b74ad8ddcefe476'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.104172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82df09e6c0304d948b74ad8ddcefe476'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.123782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82df09e6c0304d948b74ad8ddcefe476'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.150904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1047/2066] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:33 2022] DELETE /identity/v3/users/82df09e6c0304d948b74ad8ddcefe476 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:34.152559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b63ef-0b5e-4f4b-8d64-3fbbcb6d3b9c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:34.153478 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b63ef-0b5e-4f4b-8d64-3fbbcb6d3b9c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:34.153771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b63ef-0b5e-4f4b-8d64-3fbbcb6d3b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:34.179950 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-179b63ef-0b5e-4f4b-8d64-3fbbcb6d3b9c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:34.181514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-179b63ef-0b5e-4f4b-8d64-3fbbcb6d3b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:34.274048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1020/2067] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:28:34.283919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:34.285525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:34.295725 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b63ef-0b5e-4f4b-8d64-3fbbcb6d3b9c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:34.298794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-179b63ef-0b5e-4f4b-8d64-3fbbcb6d3b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:34.305330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877740a-288f-459e-97ab-908c8083e2d7 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:34.311314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:34.311967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:34.312249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:34.312562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] PATH_INFO: `/v3/users/07367a6433cd4d259e79e349d90692b1` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:34.314049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=07367a6433cd4d259e79e349d90692b1)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:34.317330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:34.382588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b63ef-0b5e-4f4b-8d64-3fbbcb6d3b9c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:34.388500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb218dc-4676-4d08-aa63-e1da7c53ffa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:34.389125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb218dc-4676-4d08-aa63-e1da7c53ffa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:34.389406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb218dc-4676-4d08-aa63-e1da7c53ffa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:34.389732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb218dc-4676-4d08-aa63-e1da7c53ffa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:34.393495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07367a6433cd4d259e79e349d90692b1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.394172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07367a6433cd4d259e79e349d90692b1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.394794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07367a6433cd4d259e79e349d90692b1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.404110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07367a6433cd4d259e79e349d90692b1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.406045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb218dc-4676-4d08-aa63-e1da7c53ffa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:34.407580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb218dc-4676-4d08-aa63-e1da7c53ffa2 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:34.416704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07367a6433cd4d259e79e349d90692b1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.419420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:34.426528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1021/2068] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:34.435314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1048/2069] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:34 2022] DELETE /identity/v3/users/07367a6433cd4d259e79e349d90692b1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:34.445055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211ca8-ec63-4479-be59-d4e8fd8b3eb7 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:34.445926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211ca8-ec63-4479-be59-d4e8fd8b3eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:34.445926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211ca8-ec63-4479-be59-d4e8fd8b3eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:34.466640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-29211ca8-ec63-4479-be59-d4e8fd8b3eb7 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:34.468029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-29211ca8-ec63-4479-be59-d4e8fd8b3eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:34.557168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1022/2070] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:34.566099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:34.567583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:34.644163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661853-990d-4d3c-9115-cc37dbb042aa admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:34.649425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8ff0-7c8d-4603-8434-3dc0c69d384d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:34.650056 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8ff0-7c8d-4603-8434-3dc0c69d384d service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:34.650339 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8ff0-7c8d-4603-8434-3dc0c69d384d service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:34.650611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8ff0-7c8d-4603-8434-3dc0c69d384d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:34.660807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f8ff0-7c8d-4603-8434-3dc0c69d384d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:34.662369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f8ff0-7c8d-4603-8434-3dc0c69d384d service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:34.674965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1049/2071] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:34.770296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29211ca8-ec63-4479-be59-d4e8fd8b3eb7 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:34.771988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-29211ca8-ec63-4479-be59-d4e8fd8b3eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:34.785963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29211ca8-ec63-4479-be59-d4e8fd8b3eb7 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:34.801000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:34.801000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:34.801000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:34.801000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] PATH_INFO: `/v3/projects/8e54a265193f4ff597467d5f35f455bd` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:34.801362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e54a265193f4ff597467d5f35f455bd)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:34.801362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:34.862447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:34.871788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e54a265193f4ff597467d5f35f455bd', 'request_id': 'req-afeeac11-96cb-4155-baff-0c6ad6e1bf13'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.879323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e54a265193f4ff597467d5f35f455bd', 'request_id': 'req-afeeac11-96cb-4155-baff-0c6ad6e1bf13'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.894519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e54a265193f4ff597467d5f35f455bd', 'request_id': 'req-afeeac11-96cb-4155-baff-0c6ad6e1bf13'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.912145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] The token cache is being invalidate because project 8e54a265193f4ff597467d5f35f455bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:34.912480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.913208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:34.914916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1023/2072] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:34 2022] DELETE /identity/v3/projects/8e54a265193f4ff597467d5f35f455bd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:34.920972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8ff0-7c8d-4603-8434-3dc0c69d384d service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:34.936043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8ff0-7c8d-4603-8434-3dc0c69d384d service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:35.012835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:35.020984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:35.021721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:35.022145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] PATH_INFO: `/v3/users/4a8c1a9b195e4e1db71cd039984d66e8` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:35.025361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8c1a9b195e4e1db71cd039984d66e8)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:35.028012 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:35.133308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8c1a9b195e4e1db71cd039984d66e8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.140552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8c1a9b195e4e1db71cd039984d66e8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.141409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8c1a9b195e4e1db71cd039984d66e8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.151787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8c1a9b195e4e1db71cd039984d66e8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.184482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8c1a9b195e4e1db71cd039984d66e8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.211863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1050/2073] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:34 2022] DELETE /identity/v3/users/4a8c1a9b195e4e1db71cd039984d66e8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:35.353367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:35.355230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:35.372689 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeac11-96cb-4155-baff-0c6ad6e1bf13 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:35.482659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:35.483439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:35.483787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:35.484148 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] PATH_INFO: `/v3/projects/934782b380634d3a8cd50d61575362e6` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:35.495296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=934782b380634d3a8cd50d61575362e6)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:35.497415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:35.572351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934782b380634d3a8cd50d61575362e6', 'request_id': 'req-4e393f90-db08-47e3-aca0-fd340d99c55e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.582411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934782b380634d3a8cd50d61575362e6', 'request_id': 'req-4e393f90-db08-47e3-aca0-fd340d99c55e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.597128 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934782b380634d3a8cd50d61575362e6', 'request_id': 'req-4e393f90-db08-47e3-aca0-fd340d99c55e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.614095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] The token cache is being invalidate because project 934782b380634d3a8cd50d61575362e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:35.614601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.615462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.617808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1024/2074] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:35 2022] DELETE /identity/v3/projects/934782b380634d3a8cd50d61575362e6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:35.621868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:35.623888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:35.640289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683a78a-1e45-49c2-b05e-f7eb4cf94718 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:35.656651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:35.787527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:35.788469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:35.789685 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:35.790100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:35.791794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:35.792296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] PATH_INFO: `/v3/users/ac9b2ac978e94de38e7487ab0218a949` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:35.795948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9b2ac978e94de38e7487ab0218a949)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:35.800446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:35.834602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393f90-db08-47e3-aca0-fd340d99c55e admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:35.855123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:35.855831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:35.856257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:35.856463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] PATH_INFO: `/v3/projects/d48e668c596c42259fdc7da956c3364a` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:35.873273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48e668c596c42259fdc7da956c3364a)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:35.877928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:35.905700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9b2ac978e94de38e7487ab0218a949'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.906645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9b2ac978e94de38e7487ab0218a949'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.907426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9b2ac978e94de38e7487ab0218a949'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.916942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9b2ac978e94de38e7487ab0218a949'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.934648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9b2ac978e94de38e7487ab0218a949'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.954884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48e668c596c42259fdc7da956c3364a', 'request_id': 'req-691eefd9-ea35-4316-9dec-9016d8852027'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.958960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:35.964343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1051/2075] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:35 2022] DELETE /identity/v3/users/ac9b2ac978e94de38e7487ab0218a949 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:35.968936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48e668c596c42259fdc7da956c3364a', 'request_id': 'req-691eefd9-ea35-4316-9dec-9016d8852027'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.980934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48e668c596c42259fdc7da956c3364a', 'request_id': 'req-691eefd9-ea35-4316-9dec-9016d8852027'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.995088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] The token cache is being invalidate because project d48e668c596c42259fdc7da956c3364a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:35.995404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:35.996083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.001451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1025/2076] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:35 2022] DELETE /identity/v3/projects/d48e668c596c42259fdc7da956c3364a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:36.005390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:36.007444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:36.095869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55894aca-065a-4455-84eb-a70b8c722fd6 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:36.103173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:36.103935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:36.104306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:36.104986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] PATH_INFO: `/v3/users/dc0dd8d801a649b6a0f0c0ab2832c0e4` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:36.107009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0dd8d801a649b6a0f0c0ab2832c0e4)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:36.109385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:36.175485 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:36.196139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0dd8d801a649b6a0f0c0ab2832c0e4'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.197256 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0dd8d801a649b6a0f0c0ab2832c0e4'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.198380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0dd8d801a649b6a0f0c0ab2832c0e4'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.207396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0dd8d801a649b6a0f0c0ab2832c0e4'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.230449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2f8aeccf-ca6c-48ee-8ba1-85505d9fa7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0dd8d801a649b6a0f0c0ab2832c0e4'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.266922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1052/2077] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:36 2022] DELETE /identity/v3/users/dc0dd8d801a649b6a0f0c0ab2832c0e4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:36.444129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:36.445926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:36.553037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eefd9-ea35-4316-9dec-9016d8852027 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:36.685553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:36.686613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:36.686781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:36.687691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] PATH_INFO: `/v3/projects/7290be7e365c44ccb5d5b7a263461ea0` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:36.689505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7290be7e365c44ccb5d5b7a263461ea0)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:36.693273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:36.760845 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7290be7e365c44ccb5d5b7a263461ea0', 'request_id': 'req-3d85861e-2bf2-47fc-ab51-840c04dce788'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.775049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7290be7e365c44ccb5d5b7a263461ea0', 'request_id': 'req-3d85861e-2bf2-47fc-ab51-840c04dce788'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.790126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7290be7e365c44ccb5d5b7a263461ea0', 'request_id': 'req-3d85861e-2bf2-47fc-ab51-840c04dce788'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.808756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] The token cache is being invalidate because project 7290be7e365c44ccb5d5b7a263461ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:36.808756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.809505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d85861e-2bf2-47fc-ab51-840c04dce788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:36.812030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1026/2078] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:36 2022] DELETE /identity/v3/projects/7290be7e365c44ccb5d5b7a263461ea0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:36.817699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e8308-3e35-4b9f-b694-a8103687e448 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:36.818663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e8308-3e35-4b9f-b694-a8103687e448 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:36.819168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e8308-3e35-4b9f-b694-a8103687e448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:36.840372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-123e8308-3e35-4b9f-b694-a8103687e448 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:36.841830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-123e8308-3e35-4b9f-b694-a8103687e448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:36.921062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1053/2079] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:36.929593 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374558-d9d9-4b45-a86a-349f0e6a2bc3 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:36.929911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374558-d9d9-4b45-a86a-349f0e6a2bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:36.930187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374558-d9d9-4b45-a86a-349f0e6a2bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:36.963519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2c374558-d9d9-4b45-a86a-349f0e6a2bc3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:36.964779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2c374558-d9d9-4b45-a86a-349f0e6a2bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:36.975480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e8308-3e35-4b9f-b694-a8103687e448 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:36.977634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-123e8308-3e35-4b9f-b694-a8103687e448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:36.982528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1027/2080] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:36.987548 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c374558-d9d9-4b45-a86a-349f0e6a2bc3 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:36.992418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e8308-3e35-4b9f-b694-a8103687e448 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:36.997448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:36.998105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:36.998739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:36.999185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] PATH_INFO: `/v3/projects/1c6b3af96f4a4b899f9abd9534a9b1f6` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.000588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6b3af96f4a4b899f9abd9534a9b1f6)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.003587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.017013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c374558-d9d9-4b45-a86a-349f0e6a2bc3 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.022850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73ff08-6a4c-4787-8d72-1fdb33e8f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.023583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73ff08-6a4c-4787-8d72-1fdb33e8f453 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.023960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73ff08-6a4c-4787-8d72-1fdb33e8f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.024326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73ff08-6a4c-4787-8d72-1fdb33e8f453 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.025127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73ff08-6a4c-4787-8d72-1fdb33e8f453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:28:37.025499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73ff08-6a4c-4787-8d72-1fdb33e8f453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.027711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73ff08-6a4c-4787-8d72-1fdb33e8f453 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.037015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:37.044442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1028/2081] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:28:37.048588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73ff08-6a4c-4787-8d72-1fdb33e8f453 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.066321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73ff08-6a4c-4787-8d72-1fdb33e8f453 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.069004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6b3af96f4a4b899f9abd9534a9b1f6', 'request_id': 'req-b971e034-b832-4a9d-ac8b-ecac5bf4a575'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:37.077196 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6b3af96f4a4b899f9abd9534a9b1f6', 'request_id': 'req-b971e034-b832-4a9d-ac8b-ecac5bf4a575'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:37.084138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6b3af96f4a4b899f9abd9534a9b1f6', 'request_id': 'req-b971e034-b832-4a9d-ac8b-ecac5bf4a575'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:37.099809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] The token cache is being invalidate because project 1c6b3af96f4a4b899f9abd9534a9b1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:37.100579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:37.100947 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b971e034-b832-4a9d-ac8b-ecac5bf4a575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:37.102869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1054/2082] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:36 2022] DELETE /identity/v3/projects/1c6b3af96f4a4b899f9abd9534a9b1f6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:37.107973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c246eb6-9b2d-4f18-abb9-f2af565584e5 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.108624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c246eb6-9b2d-4f18-abb9-f2af565584e5 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.109055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c246eb6-9b2d-4f18-abb9-f2af565584e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.131086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1c246eb6-9b2d-4f18-abb9-f2af565584e5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:37.132464 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1c246eb6-9b2d-4f18-abb9-f2af565584e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:37.137377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54834a-f31a-4d89-8693-20a83c6703ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.138049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54834a-f31a-4d89-8693-20a83c6703ee admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.138846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54834a-f31a-4d89-8693-20a83c6703ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.139240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54834a-f31a-4d89-8693-20a83c6703ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.139992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54834a-f31a-4d89-8693-20a83c6703ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.141563 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1055/2083] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:28:37.142267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54834a-f31a-4d89-8693-20a83c6703ee admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.149441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1869cd-fafe-4a43-987e-4b42574a3e43 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.149728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1869cd-fafe-4a43-987e-4b42574a3e43 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.149999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1869cd-fafe-4a43-987e-4b42574a3e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.174663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0b1869cd-fafe-4a43-987e-4b42574a3e43 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:37.175920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0b1869cd-fafe-4a43-987e-4b42574a3e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:37.183091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1029/2084] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:37 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:37.184461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54834a-f31a-4d89-8693-20a83c6703ee admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.186508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-fa54834a-f31a-4d89-8693-20a83c6703ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:37.206199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:37.251379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1056/2085] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:28:37.258530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1869cd-fafe-4a43-987e-4b42574a3e43 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.265161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54834a-f31a-4d89-8693-20a83c6703ee admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.270431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58742-67fa-4b94-8e7d-c36a34211fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.271255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58742-67fa-4b94-8e7d-c36a34211fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.271710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58742-67fa-4b94-8e7d-c36a34211fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.272044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1869cd-fafe-4a43-987e-4b42574a3e43 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.272300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58742-67fa-4b94-8e7d-c36a34211fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.273123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d58742-67fa-4b94-8e7d-c36a34211fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.275263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d58742-67fa-4b94-8e7d-c36a34211fd8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.277843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847f849-44a0-42c8-8556-9e30fc331dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.278515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f849-44a0-42c8-8556-9e30fc331dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.278809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f849-44a0-42c8-8556-9e30fc331dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.279107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f849-44a0-42c8-8556-9e30fc331dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.279793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f849-44a0-42c8-8556-9e30fc331dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:28:37.280092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f849-44a0-42c8-8556-9e30fc331dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.282062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f849-44a0-42c8-8556-9e30fc331dcf admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.305635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1057/2086] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:28:37.306761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847f849-44a0-42c8-8556-9e30fc331dcf admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.314177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1030/2087] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:37 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:37.315161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58742-67fa-4b94-8e7d-c36a34211fd8 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.318525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847f849-44a0-42c8-8556-9e30fc331dcf admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.329694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203e688-236b-49db-97af-e2aa2ff48dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.330070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203e688-236b-49db-97af-e2aa2ff48dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.330280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203e688-236b-49db-97af-e2aa2ff48dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.330554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203e688-236b-49db-97af-e2aa2ff48dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.331215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203e688-236b-49db-97af-e2aa2ff48dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.333440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203e688-236b-49db-97af-e2aa2ff48dd6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.333836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58742-67fa-4b94-8e7d-c36a34211fd8 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.343358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c661976-2608-4fb2-839b-0ac40f5d8987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.344090 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c661976-2608-4fb2-839b-0ac40f5d8987 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.344488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c661976-2608-4fb2-839b-0ac40f5d8987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.344831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c661976-2608-4fb2-839b-0ac40f5d8987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.345551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c661976-2608-4fb2-839b-0ac40f5d8987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.347241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c661976-2608-4fb2-839b-0ac40f5d8987 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.360304 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1031/2088] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:37.364605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c661976-2608-4fb2-839b-0ac40f5d8987 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.377659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c661976-2608-4fb2-839b-0ac40f5d8987 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.384883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b991a-4083-4f28-aa76-d9d7222e4f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.386453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b991a-4083-4f28-aa76-d9d7222e4f2c admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.386947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b991a-4083-4f28-aa76-d9d7222e4f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.387329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b991a-4083-4f28-aa76-d9d7222e4f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.388748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1058/2089] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:37 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:37.392166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b991a-4083-4f28-aa76-d9d7222e4f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.393079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203e688-236b-49db-97af-e2aa2ff48dd6 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.394777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b991a-4083-4f28-aa76-d9d7222e4f2c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.410132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1032/2090] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:37.414302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b991a-4083-4f28-aa76-d9d7222e4f2c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.427590 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b991a-4083-4f28-aa76-d9d7222e4f2c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.492912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:37.493731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203e688-236b-49db-97af-e2aa2ff48dd6 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.519834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4d141-66a2-401d-aaf7-84e129194471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.521135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4d141-66a2-401d-aaf7-84e129194471 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.521135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4d141-66a2-401d-aaf7-84e129194471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.521352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4d141-66a2-401d-aaf7-84e129194471 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.521844 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4d141-66a2-401d-aaf7-84e129194471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.523925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4d141-66a2-401d-aaf7-84e129194471 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.531206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b937-fbdb-41ae-b8a7-ee78ad11c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.534878 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b937-fbdb-41ae-b8a7-ee78ad11c702 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.535525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b937-fbdb-41ae-b8a7-ee78ad11c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.536024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b937-fbdb-41ae-b8a7-ee78ad11c702 admin admin] PATH_INFO: `/v3/projects/735ae464bbfa4b42b4acea9cded33cc1/users/2ed97c6189924fc6803026e20a5d21d4/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.555120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1059/2091] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:37 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:28:37.559410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4d141-66a2-401d-aaf7-84e129194471 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.569340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b937-fbdb-41ae-b8a7-ee78ad11c702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735ae464bbfa4b42b4acea9cded33cc1, user_id=2ed97c6189924fc6803026e20a5d21d4, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.572087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b937-fbdb-41ae-b8a7-ee78ad11c702 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.576032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4d141-66a2-401d-aaf7-84e129194471 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.581741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38851ed7-5025-498e-bbcd-d662fe7a5e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.582838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38851ed7-5025-498e-bbcd-d662fe7a5e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.582838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38851ed7-5025-498e-bbcd-d662fe7a5e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.583248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38851ed7-5025-498e-bbcd-d662fe7a5e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.583978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38851ed7-5025-498e-bbcd-d662fe7a5e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.586195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38851ed7-5025-498e-bbcd-d662fe7a5e75 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.588038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1033/2092] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:37 2022] PUT /identity/v3/projects/735ae464bbfa4b42b4acea9cded33cc1/users/2ed97c6189924fc6803026e20a5d21d4/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:37.601691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1060/2093] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:37.601905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b049358-01ee-4349-a9cc-d590bf2d8195 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.601905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b049358-01ee-4349-a9cc-d590bf2d8195 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.601905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b049358-01ee-4349-a9cc-d590bf2d8195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.602983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38851ed7-5025-498e-bbcd-d662fe7a5e75 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.614595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38851ed7-5025-498e-bbcd-d662fe7a5e75 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.637276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-0b049358-01ee-4349-a9cc-d590bf2d8195 None None] MFA Rules not processed for user `2ed97c6189924fc6803026e20a5d21d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:37.639187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0b049358-01ee-4349-a9cc-d590bf2d8195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:37.687536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c437-fdfa-4cb2-bfe2-fa6c102217c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.688310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c437-fdfa-4cb2-bfe2-fa6c102217c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.688681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c437-fdfa-4cb2-bfe2-fa6c102217c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.688983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c437-fdfa-4cb2-bfe2-fa6c102217c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.689754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7c437-fdfa-4cb2-bfe2-fa6c102217c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.691448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7c437-fdfa-4cb2-bfe2-fa6c102217c1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.704142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1061/2094] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:37.707872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c437-fdfa-4cb2-bfe2-fa6c102217c1 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.718947 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c437-fdfa-4cb2-bfe2-fa6c102217c1 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.724357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69256-45d0-4e67-8e59-57bf1cac5268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.725208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69256-45d0-4e67-8e59-57bf1cac5268 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.725494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69256-45d0-4e67-8e59-57bf1cac5268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.725771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69256-45d0-4e67-8e59-57bf1cac5268 admin admin] PATH_INFO: `/v3/projects/d7fc1dae09f145afab37db3a792430d3/users/7198bde056f148778f52346c3ecedfe5/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.739488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:37.742832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1034/2095] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:28:37.748133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b049358-01ee-4349-a9cc-d590bf2d8195 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.759588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c69256-45d0-4e67-8e59-57bf1cac5268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fc1dae09f145afab37db3a792430d3, user_id=7198bde056f148778f52346c3ecedfe5, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.762017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b049358-01ee-4349-a9cc-d590bf2d8195 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.763711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c69256-45d0-4e67-8e59-57bf1cac5268 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.772528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43097e6-6556-44eb-9c85-9d8256271f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.773477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43097e6-6556-44eb-9c85-9d8256271f73 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.773919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43097e6-6556-44eb-9c85-9d8256271f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.774199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43097e6-6556-44eb-9c85-9d8256271f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.774841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43097e6-6556-44eb-9c85-9d8256271f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.777902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43097e6-6556-44eb-9c85-9d8256271f73 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.782331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1062/2096] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:37 2022] PUT /identity/v3/projects/d7fc1dae09f145afab37db3a792430d3/users/7198bde056f148778f52346c3ecedfe5/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:37.787138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b505461-0ee7-4631-b3b2-23f20b30724b None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.787424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b505461-0ee7-4631-b3b2-23f20b30724b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.787699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b505461-0ee7-4631-b3b2-23f20b30724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.812212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-2b505461-0ee7-4631-b3b2-23f20b30724b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:37.813711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2b505461-0ee7-4631-b3b2-23f20b30724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:37.820458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1035/2097] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:37 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:28:37.822177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43097e6-6556-44eb-9c85-9d8256271f73 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.898247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1063/2098] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:37.907575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43097e6-6556-44eb-9c85-9d8256271f73 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.911906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b505461-0ee7-4631-b3b2-23f20b30724b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.913986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2b505461-0ee7-4631-b3b2-23f20b30724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:37.926914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d3866-5088-480b-8e2a-243c67f41162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.927831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3866-5088-480b-8e2a-243c67f41162 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.928121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3866-5088-480b-8e2a-243c67f41162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.928576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3866-5088-480b-8e2a-243c67f41162 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.930874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d3866-5088-480b-8e2a-243c67f41162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:37.935332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d3866-5088-480b-8e2a-243c67f41162 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:37.972096 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1036/2099] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:37 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:28:37.973117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d3866-5088-480b-8e2a-243c67f41162 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:37.988573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d3866-5088-480b-8e2a-243c67f41162 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:37.995677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e761695-7e83-411f-93d3-2a2161a0fcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:37.996360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e761695-7e83-411f-93d3-2a2161a0fcaf admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:37.996688 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e761695-7e83-411f-93d3-2a2161a0fcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:37.997568 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e761695-7e83-411f-93d3-2a2161a0fcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:37.998808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e761695-7e83-411f-93d3-2a2161a0fcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:38.001909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e761695-7e83-411f-93d3-2a2161a0fcaf admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:38.008428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b505461-0ee7-4631-b3b2-23f20b30724b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:38.017684 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1037/2100] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:38.019989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e761695-7e83-411f-93d3-2a2161a0fcaf admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:38.043006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e761695-7e83-411f-93d3-2a2161a0fcaf admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:38.057427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5702-ac9a-4234-94de-1c341c50eb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:38.058111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5702-ac9a-4234-94de-1c341c50eb66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:38.058390 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5702-ac9a-4234-94de-1c341c50eb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:38.058660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5702-ac9a-4234-94de-1c341c50eb66 admin admin] PATH_INFO: `/v3/projects/7b927b67182e4c3fbe820af079e709b4/users/685f5e1ca7414cb698b91d70a0ab15f1/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:38.075663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5702-ac9a-4234-94de-1c341c50eb66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b927b67182e4c3fbe820af079e709b4, user_id=685f5e1ca7414cb698b91d70a0ab15f1, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:38.078514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5702-ac9a-4234-94de-1c341c50eb66 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:38.082863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:38.103064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1038/2101] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:38 2022] PUT /identity/v3/projects/7b927b67182e4c3fbe820af079e709b4/users/685f5e1ca7414cb698b91d70a0ab15f1/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:38.107327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5702-ac9a-4234-94de-1c341c50eb66 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:38.116350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006c8b7-687b-46ba-a7f5-0a4ba5c61e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:38.117865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006c8b7-687b-46ba-a7f5-0a4ba5c61e50 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:38.118155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006c8b7-687b-46ba-a7f5-0a4ba5c61e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:38.120904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006c8b7-687b-46ba-a7f5-0a4ba5c61e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:38.150797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006c8b7-687b-46ba-a7f5-0a4ba5c61e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:38.152509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006c8b7-687b-46ba-a7f5-0a4ba5c61e50 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:38.167306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1064/2102] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:38.206313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5702-ac9a-4234-94de-1c341c50eb66 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:38.212027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a38044-7f6b-493a-b29f-ecfa3d5ea2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:38.212811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a38044-7f6b-493a-b29f-ecfa3d5ea2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:38.213266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a38044-7f6b-493a-b29f-ecfa3d5ea2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:38.213655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a38044-7f6b-493a-b29f-ecfa3d5ea2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:38.214473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a38044-7f6b-493a-b29f-ecfa3d5ea2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:38.217342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a38044-7f6b-493a-b29f-ecfa3d5ea2a4 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:38.234676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1039/2103] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:38.239609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006c8b7-687b-46ba-a7f5-0a4ba5c61e50 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:38.250358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006c8b7-687b-46ba-a7f5-0a4ba5c61e50 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:38.257540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71882995-139b-4acd-b6de-19cd6fc6d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:38.258356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882995-139b-4acd-b6de-19cd6fc6d69b admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:38.258723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882995-139b-4acd-b6de-19cd6fc6d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:38.259067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882995-139b-4acd-b6de-19cd6fc6d69b admin admin] PATH_INFO: `/v3/projects/7b927b67182e4c3fbe820af079e709b4/users/685f5e1ca7414cb698b91d70a0ab15f1/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:38.261737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71882995-139b-4acd-b6de-19cd6fc6d69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b927b67182e4c3fbe820af079e709b4, user_id=685f5e1ca7414cb698b91d70a0ab15f1, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:38.266963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71882995-139b-4acd-b6de-19cd6fc6d69b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:38.280436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1065/2104] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:38 2022] PUT /identity/v3/projects/7b927b67182e4c3fbe820af079e709b4/users/685f5e1ca7414cb698b91d70a0ab15f1/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:38.291364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ced08-cd5c-47a8-92e4-12b8c9b2e4b0 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:38.291654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ced08-cd5c-47a8-92e4-12b8c9b2e4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:38.291934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ced08-cd5c-47a8-92e4-12b8c9b2e4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:38.323787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-1f7ced08-cd5c-47a8-92e4-12b8c9b2e4b0 None None] MFA Rules not processed for user `685f5e1ca7414cb698b91d70a0ab15f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:38.325273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-1f7ced08-cd5c-47a8-92e4-12b8c9b2e4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:38.444926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1040/2105] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:38.457619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71882995-139b-4acd-b6de-19cd6fc6d69b admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:38.459222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-71882995-139b-4acd-b6de-19cd6fc6d69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:38.505269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:38.537611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71882995-139b-4acd-b6de-19cd6fc6d69b admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:38.541855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c63496-dfbc-40a1-ac37-3e5fb3fa2dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:38.543592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c63496-dfbc-40a1-ac37-3e5fb3fa2dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:38.544725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c63496-dfbc-40a1-ac37-3e5fb3fa2dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:38.551708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c63496-dfbc-40a1-ac37-3e5fb3fa2dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:38.578131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c63496-dfbc-40a1-ac37-3e5fb3fa2dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:38.580512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c63496-dfbc-40a1-ac37-3e5fb3fa2dc4 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:38.597033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1066/2106] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:39.321557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ced08-cd5c-47a8-92e4-12b8c9b2e4b0 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:39.472325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ced08-cd5c-47a8-92e4-12b8c9b2e4b0 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:39.490053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:39.491008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:39.491298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:39.491577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] PATH_INFO: `/v3/users/2ed97c6189924fc6803026e20a5d21d4` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:39.495749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed97c6189924fc6803026e20a5d21d4)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:39.501184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:39.564557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:39.636916 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed97c6189924fc6803026e20a5d21d4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:39.637757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed97c6189924fc6803026e20a5d21d4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:39.652994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed97c6189924fc6803026e20a5d21d4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:39.685611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed97c6189924fc6803026e20a5d21d4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:39.687535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed97c6189924fc6803026e20a5d21d4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:39.725451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1041/2107] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:39 2022] DELETE /identity/v3/users/2ed97c6189924fc6803026e20a5d21d4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:39.727525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d60be-9689-4063-8d48-5f5b4cddb4df None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:39.729181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d60be-9689-4063-8d48-5f5b4cddb4df None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:39.729710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d60be-9689-4063-8d48-5f5b4cddb4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:39.765192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-342d60be-9689-4063-8d48-5f5b4cddb4df None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:39.766888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-342d60be-9689-4063-8d48-5f5b4cddb4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:39.841991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:39.845586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:39.967044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1067/2108] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:40.036976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d60be-9689-4063-8d48-5f5b4cddb4df None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:40.038600 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-342d60be-9689-4063-8d48-5f5b4cddb4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:40.050731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb0323-8224-4597-9073-e24aa02bb800 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:40.065581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:40.066316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:40.066598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:40.066871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] PATH_INFO: `/v3/users/c08db26d8866490fa83b373d65f722db` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:40.070482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08db26d8866490fa83b373d65f722db)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:40.072479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:40.185481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08db26d8866490fa83b373d65f722db'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:40.186207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08db26d8866490fa83b373d65f722db'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:40.197476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08db26d8866490fa83b373d65f722db'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:40.203288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d60be-9689-4063-8d48-5f5b4cddb4df None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:40.214006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08db26d8866490fa83b373d65f722db'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:40.214723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4e2cda2-25f2-478b-9389-187826befd8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08db26d8866490fa83b373d65f722db'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:40.222229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0862461-5b73-453d-b22f-ba32c3667167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:40.222683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0862461-5b73-453d-b22f-ba32c3667167 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:40.222995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0862461-5b73-453d-b22f-ba32c3667167 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:40.223300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0862461-5b73-453d-b22f-ba32c3667167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:40.229875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d0862461-5b73-453d-b22f-ba32c3667167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:40.240628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1042/2109] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:39 2022] DELETE /identity/v3/users/c08db26d8866490fa83b373d65f722db => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:40.245857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd5f92-83b4-47e7-9994-5a7e1ea1d305 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:40.246649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd5f92-83b4-47e7-9994-5a7e1ea1d305 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:40.246649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd5f92-83b4-47e7-9994-5a7e1ea1d305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:40.272765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0862461-5b73-453d-b22f-ba32c3667167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:40.274245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0862461-5b73-453d-b22f-ba32c3667167 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:40.285600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-3acd5f92-83b4-47e7-9994-5a7e1ea1d305 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:40.287569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3acd5f92-83b4-47e7-9994-5a7e1ea1d305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:40.301370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1068/2110] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:40.303383 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:40.383422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1043/2111] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:40.403890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0862461-5b73-453d-b22f-ba32c3667167 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:40.405460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d0862461-5b73-453d-b22f-ba32c3667167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:40.426293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0862461-5b73-453d-b22f-ba32c3667167 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:40.510972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97631ac-493d-421b-b5c6-bb24099a082a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:40.511597 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97631ac-493d-421b-b5c6-bb24099a082a service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:40.511871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97631ac-493d-421b-b5c6-bb24099a082a service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:40.512140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97631ac-493d-421b-b5c6-bb24099a082a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:40.522918 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97631ac-493d-421b-b5c6-bb24099a082a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:40.524605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97631ac-493d-421b-b5c6-bb24099a082a service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:40.536112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1069/2112] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:41.400512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd5f92-83b4-47e7-9994-5a7e1ea1d305 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:41.402098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3acd5f92-83b4-47e7-9994-5a7e1ea1d305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:41.416353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd5f92-83b4-47e7-9994-5a7e1ea1d305 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:41.425299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:41.425969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:41.426363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:41.427290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] PATH_INFO: `/v3/projects/735ae464bbfa4b42b4acea9cded33cc1` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:41.429118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=735ae464bbfa4b42b4acea9cded33cc1)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:41.431408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:41.483619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97631ac-493d-421b-b5c6-bb24099a082a service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:41.485975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a97631ac-493d-421b-b5c6-bb24099a082a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:41.513858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97631ac-493d-421b-b5c6-bb24099a082a service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:41.516696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735ae464bbfa4b42b4acea9cded33cc1', 'request_id': 'req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.527561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735ae464bbfa4b42b4acea9cded33cc1', 'request_id': 'req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.550546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735ae464bbfa4b42b4acea9cded33cc1', 'request_id': 'req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.553970 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:41.570102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] The token cache is being invalidate because project 735ae464bbfa4b42b4acea9cded33cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:41.570670 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.571493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.573949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1044/2113] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:41 2022] DELETE /identity/v3/projects/735ae464bbfa4b42b4acea9cded33cc1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:41.581723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:41.583298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:41.642642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:41.643596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:41.644338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:41.645146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] PATH_INFO: `/v3/projects/e6704532ce49478ea5ca1be3a8fd31ba` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:41.648029 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6704532ce49478ea5ca1be3a8fd31ba)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:41.650081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:41.711786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b4ac9-0d0a-40c4-8bc5-31b091c46d5d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:41.717361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:41.718021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:41.718305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:41.718584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] PATH_INFO: `/v3/users/685f5e1ca7414cb698b91d70a0ab15f1` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:41.720351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=685f5e1ca7414cb698b91d70a0ab15f1)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:41.723111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:41.741001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6704532ce49478ea5ca1be3a8fd31ba', 'request_id': 'req-94298f7f-3d94-459e-8f74-b51ec297bd3c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.761212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6704532ce49478ea5ca1be3a8fd31ba', 'request_id': 'req-94298f7f-3d94-459e-8f74-b51ec297bd3c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.778285 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6704532ce49478ea5ca1be3a8fd31ba', 'request_id': 'req-94298f7f-3d94-459e-8f74-b51ec297bd3c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.818443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] The token cache is being invalidate because project e6704532ce49478ea5ca1be3a8fd31ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:41.819121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.819842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.821668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:41.821991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1070/2114] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:41 2022] DELETE /identity/v3/projects/e6704532ce49478ea5ca1be3a8fd31ba => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:41.863474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685f5e1ca7414cb698b91d70a0ab15f1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.864619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685f5e1ca7414cb698b91d70a0ab15f1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.889766 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685f5e1ca7414cb698b91d70a0ab15f1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.937625 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685f5e1ca7414cb698b91d70a0ab15f1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.940925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-06f84094-34df-4ce2-bccc-2281401c9f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685f5e1ca7414cb698b91d70a0ab15f1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:41.980646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1045/2115] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:41 2022] DELETE /identity/v3/users/685f5e1ca7414cb698b91d70a0ab15f1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:42.404938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:42.406417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:42.594059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94298f7f-3d94-459e-8f74-b51ec297bd3c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:42.698416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:42.708363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:42.709752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:42.709752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:42.709977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] PATH_INFO: `/v3/projects/7b927b67182e4c3fbe820af079e709b4` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:42.711074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b927b67182e4c3fbe820af079e709b4)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:42.713247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:42.781471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b927b67182e4c3fbe820af079e709b4', 'request_id': 'req-6f9b15bb-ad55-4060-9efa-465552347408'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:42.788929 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b927b67182e4c3fbe820af079e709b4', 'request_id': 'req-6f9b15bb-ad55-4060-9efa-465552347408'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:42.799893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b927b67182e4c3fbe820af079e709b4', 'request_id': 'req-6f9b15bb-ad55-4060-9efa-465552347408'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:42.819132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] The token cache is being invalidate because project 7b927b67182e4c3fbe820af079e709b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:42.819637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:42.820104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-6f9b15bb-ad55-4060-9efa-465552347408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:42.822081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1071/2116] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:42 2022] DELETE /identity/v3/projects/7b927b67182e4c3fbe820af079e709b4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:42.826951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd6181-ea97-456f-95d1-cfc5b19882f9 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:42.827482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd6181-ea97-456f-95d1-cfc5b19882f9 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:42.827482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd6181-ea97-456f-95d1-cfc5b19882f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:42.851462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-cabd6181-ea97-456f-95d1-cfc5b19882f9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:42.852925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-cabd6181-ea97-456f-95d1-cfc5b19882f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:42.927261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1046/2117] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:42.935460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d661c97-c7c5-49a6-9535-050021a33364 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:42.935748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d661c97-c7c5-49a6-9535-050021a33364 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:42.936022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d661c97-c7c5-49a6-9535-050021a33364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:42.958267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-9d661c97-c7c5-49a6-9535-050021a33364 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:42.959807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9d661c97-c7c5-49a6-9535-050021a33364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:42.971535 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1072/2118] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:42.973093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd6181-ea97-456f-95d1-cfc5b19882f9 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:42.985260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd6181-ea97-456f-95d1-cfc5b19882f9 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:42.991118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afd631-5008-4590-9025-81337c363e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:42.991752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd631-5008-4590-9025-81337c363e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:42.992033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd631-5008-4590-9025-81337c363e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:42.992309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd631-5008-4590-9025-81337c363e47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:42.993177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afd631-5008-4590-9025-81337c363e47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:28:42.993626 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afd631-5008-4590-9025-81337c363e47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:42.995416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afd631-5008-4590-9025-81337c363e47 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:43.011190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1047/2119] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:28:43.015923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d661c97-c7c5-49a6-9535-050021a33364 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:43.026652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d661c97-c7c5-49a6-9535-050021a33364 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:43.031662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb727661-8f2d-4257-9ce4-b2b96b255201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:43.033049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb727661-8f2d-4257-9ce4-b2b96b255201 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:43.033173 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb727661-8f2d-4257-9ce4-b2b96b255201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:43.033376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb727661-8f2d-4257-9ce4-b2b96b255201 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:43.034046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb727661-8f2d-4257-9ce4-b2b96b255201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:43.035976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb727661-8f2d-4257-9ce4-b2b96b255201 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:43.084425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1073/2120] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:43 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:28:43.085844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afd631-5008-4590-9025-81337c363e47 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:43.097307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afd631-5008-4590-9025-81337c363e47 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:43.186594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5012cb-c3ba-4fb3-9d9e-3c500c9f9d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:43.187214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5012cb-c3ba-4fb3-9d9e-3c500c9f9d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:43.187522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5012cb-c3ba-4fb3-9d9e-3c500c9f9d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:43.187820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5012cb-c3ba-4fb3-9d9e-3c500c9f9d05 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:43.188804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5012cb-c3ba-4fb3-9d9e-3c500c9f9d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:43.190883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5012cb-c3ba-4fb3-9d9e-3c500c9f9d05 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:43.220890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1048/2121] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:43 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:43.224770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb727661-8f2d-4257-9ce4-b2b96b255201 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:43.236878 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb727661-8f2d-4257-9ce4-b2b96b255201 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:43.242894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05436dc-2738-4320-b243-8703bf228be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:43.243575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05436dc-2738-4320-b243-8703bf228be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:43.243793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05436dc-2738-4320-b243-8703bf228be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:43.244074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05436dc-2738-4320-b243-8703bf228be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:43.244752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05436dc-2738-4320-b243-8703bf228be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:43.246376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05436dc-2738-4320-b243-8703bf228be1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:43.260894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1074/2122] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:43.264950 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5012cb-c3ba-4fb3-9d9e-3c500c9f9d05 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:43.280192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5012cb-c3ba-4fb3-9d9e-3c500c9f9d05 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:43.286468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fdb2b-5337-48cf-a8b3-8da9f8b73974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:43.287201 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fdb2b-5337-48cf-a8b3-8da9f8b73974 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:43.287579 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fdb2b-5337-48cf-a8b3-8da9f8b73974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:43.287928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fdb2b-5337-48cf-a8b3-8da9f8b73974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:43.289071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fdb2b-5337-48cf-a8b3-8da9f8b73974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:43.291070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fdb2b-5337-48cf-a8b3-8da9f8b73974 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:43.309202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1049/2123] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:43.309853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05436dc-2738-4320-b243-8703bf228be1 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:43.322369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05436dc-2738-4320-b243-8703bf228be1 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:43.327883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b0f80-cf93-4215-8f9d-31a7716c042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:43.328969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b0f80-cf93-4215-8f9d-31a7716c042f admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:43.329252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b0f80-cf93-4215-8f9d-31a7716c042f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:43.329543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b0f80-cf93-4215-8f9d-31a7716c042f admin admin] PATH_INFO: `/v3/projects/2470f64d267049d68e9bbba9d6d0275c/users/a41e13dce33048e883452fef20d91552/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:43.359878 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b0f80-cf93-4215-8f9d-31a7716c042f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2470f64d267049d68e9bbba9d6d0275c, user_id=a41e13dce33048e883452fef20d91552, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:43.363492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b0f80-cf93-4215-8f9d-31a7716c042f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:43.384912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1075/2124] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:43 2022] PUT /identity/v3/projects/2470f64d267049d68e9bbba9d6d0275c/users/a41e13dce33048e883452fef20d91552/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:43.397340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215c8a-93b2-4c1c-b46a-cf7d146c5f71 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:43.397623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215c8a-93b2-4c1c-b46a-cf7d146c5f71 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:43.397976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215c8a-93b2-4c1c-b46a-cf7d146c5f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:43.436898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-62215c8a-93b2-4c1c-b46a-cf7d146c5f71 None None] MFA Rules not processed for user `a41e13dce33048e883452fef20d91552`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:43.439208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-62215c8a-93b2-4c1c-b46a-cf7d146c5f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:43.458924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:43.542069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1050/2125] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:43.546850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b0f80-cf93-4215-8f9d-31a7716c042f admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:43.640089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b0f80-cf93-4215-8f9d-31a7716c042f admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:43.645916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977126d6-7667-416f-9d51-05e4bf84ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:43.646648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977126d6-7667-416f-9d51-05e4bf84ec75 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:43.647020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977126d6-7667-416f-9d51-05e4bf84ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:43.648270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977126d6-7667-416f-9d51-05e4bf84ec75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:43.649186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977126d6-7667-416f-9d51-05e4bf84ec75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:43.651786 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977126d6-7667-416f-9d51-05e4bf84ec75 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:43.683884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1076/2126] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:43 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:43.688139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215c8a-93b2-4c1c-b46a-cf7d146c5f71 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:43.699006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215c8a-93b2-4c1c-b46a-cf7d146c5f71 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:43.784819 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ad37d-4bdc-4bf8-80ba-4f4bda95c28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:43.785447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ad37d-4bdc-4bf8-80ba-4f4bda95c28e admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:43.785724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ad37d-4bdc-4bf8-80ba-4f4bda95c28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:43.785993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ad37d-4bdc-4bf8-80ba-4f4bda95c28e admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:43.786628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ad37d-4bdc-4bf8-80ba-4f4bda95c28e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:43.788743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ad37d-4bdc-4bf8-80ba-4f4bda95c28e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:43.817301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1051/2127] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:43 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:43.818593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977126d6-7667-416f-9d51-05e4bf84ec75 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:43.829342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977126d6-7667-416f-9d51-05e4bf84ec75 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:43.834749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39534b4-f5b4-483a-a3d6-f5e36aa76780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:43.835928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39534b4-f5b4-483a-a3d6-f5e36aa76780 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:43.836223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39534b4-f5b4-483a-a3d6-f5e36aa76780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:43.836534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39534b4-f5b4-483a-a3d6-f5e36aa76780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:43.837183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39534b4-f5b4-483a-a3d6-f5e36aa76780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:43.838804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39534b4-f5b4-483a-a3d6-f5e36aa76780 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:43.842102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:43.852472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1077/2128] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:43.857843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ad37d-4bdc-4bf8-80ba-4f4bda95c28e admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:43.872895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ad37d-4bdc-4bf8-80ba-4f4bda95c28e admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:43.881946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bf1e4-20bb-4bde-bd6b-86b2a682955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:43.882837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bf1e4-20bb-4bde-bd6b-86b2a682955d admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:43.883300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bf1e4-20bb-4bde-bd6b-86b2a682955d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:43.884491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bf1e4-20bb-4bde-bd6b-86b2a682955d admin admin] PATH_INFO: `/v3/projects/d264071099cf4c71b05762188adbe1e4/users/4c40df4d392342509a0b52153e910e0b/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:43.908178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bf1e4-20bb-4bde-bd6b-86b2a682955d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d264071099cf4c71b05762188adbe1e4, user_id=4c40df4d392342509a0b52153e910e0b, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:43.911034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bf1e4-20bb-4bde-bd6b-86b2a682955d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:43.927841 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1052/2129] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:43 2022] PUT /identity/v3/projects/d264071099cf4c71b05762188adbe1e4/users/4c40df4d392342509a0b52153e910e0b/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:43.932053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39534b4-f5b4-483a-a3d6-f5e36aa76780 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:43.942992 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39534b4-f5b4-483a-a3d6-f5e36aa76780 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:44.009882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5538c4-4d67-45a9-8d0f-78ce01463e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:44.012371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5538c4-4d67-45a9-8d0f-78ce01463e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:44.013250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5538c4-4d67-45a9-8d0f-78ce01463e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:44.013688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5538c4-4d67-45a9-8d0f-78ce01463e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:44.014952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5538c4-4d67-45a9-8d0f-78ce01463e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:44.017163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5538c4-4d67-45a9-8d0f-78ce01463e05 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:44.035310 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1078/2130] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:44.036615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bf1e4-20bb-4bde-bd6b-86b2a682955d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:44.047267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bf1e4-20bb-4bde-bd6b-86b2a682955d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:44.051831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3e82b-55c3-47a6-a087-6ebd343624ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:44.052536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e82b-55c3-47a6-a087-6ebd343624ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:44.052819 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e82b-55c3-47a6-a087-6ebd343624ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:44.054110 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e82b-55c3-47a6-a087-6ebd343624ea admin admin] PATH_INFO: `/v3/projects/d264071099cf4c71b05762188adbe1e4/users/4c40df4d392342509a0b52153e910e0b/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:44.055032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3e82b-55c3-47a6-a087-6ebd343624ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d264071099cf4c71b05762188adbe1e4, user_id=4c40df4d392342509a0b52153e910e0b, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:44.057747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3e82b-55c3-47a6-a087-6ebd343624ea admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:44.069813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1053/2131] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:44 2022] PUT /identity/v3/projects/d264071099cf4c71b05762188adbe1e4/users/4c40df4d392342509a0b52153e910e0b/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:44.080462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef981dcc-bf47-422c-acf8-65f18e2d9833 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:44.080830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef981dcc-bf47-422c-acf8-65f18e2d9833 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:44.081277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef981dcc-bf47-422c-acf8-65f18e2d9833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:44.117399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ef981dcc-bf47-422c-acf8-65f18e2d9833 None None] MFA Rules not processed for user `4c40df4d392342509a0b52153e910e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:44.119356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ef981dcc-bf47-422c-acf8-65f18e2d9833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:44.231033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3e82b-55c3-47a6-a087-6ebd343624ea admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:44.232895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1079/2132] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:44.235038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7cc3e82b-55c3-47a6-a087-6ebd343624ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:44.323778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3e82b-55c3-47a6-a087-6ebd343624ea admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:44.327836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f58c46-864e-49b8-8bad-1f3cbd9643ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:44.329693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f58c46-864e-49b8-8bad-1f3cbd9643ed service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:44.329693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f58c46-864e-49b8-8bad-1f3cbd9643ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:44.329693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f58c46-864e-49b8-8bad-1f3cbd9643ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:44.350682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:44.406599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f58c46-864e-49b8-8bad-1f3cbd9643ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:44.408600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f58c46-864e-49b8-8bad-1f3cbd9643ed service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:44.425125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1054/2133] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:45.392725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed90ebd-baf0-4e3a-9dee-914a423cf28d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:45.393311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed90ebd-baf0-4e3a-9dee-914a423cf28d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:45.393311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed90ebd-baf0-4e3a-9dee-914a423cf28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:45.424576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4ed90ebd-baf0-4e3a-9dee-914a423cf28d None None] MFA Rules not processed for user `7198bde056f148778f52346c3ecedfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:45.425996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4ed90ebd-baf0-4e3a-9dee-914a423cf28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:45.504344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1080/2134] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:45.509692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f58c46-864e-49b8-8bad-1f3cbd9643ed service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:45.510875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-55f58c46-864e-49b8-8bad-1f3cbd9643ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:45.591546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f58c46-864e-49b8-8bad-1f3cbd9643ed service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:45.596287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3305-553b-480b-a06d-0454d0ed0880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:45.596942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3305-553b-480b-a06d-0454d0ed0880 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:45.597219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3305-553b-480b-a06d-0454d0ed0880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:45.597485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3305-553b-480b-a06d-0454d0ed0880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:45.598125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c3305-553b-480b-a06d-0454d0ed0880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:45.600089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c3305-553b-480b-a06d-0454d0ed0880 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:45.638692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1055/2135] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:45 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:45.639803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed90ebd-baf0-4e3a-9dee-914a423cf28d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:45.651756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed90ebd-baf0-4e3a-9dee-914a423cf28d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:45.657165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:45.725100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1c99-29ff-486c-bee1-3d2be5c50d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:45.725751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1c99-29ff-486c-bee1-3d2be5c50d79 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:45.726032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1c99-29ff-486c-bee1-3d2be5c50d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:45.726334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1c99-29ff-486c-bee1-3d2be5c50d79 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:45.726996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1c99-29ff-486c-bee1-3d2be5c50d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:45.729006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1c99-29ff-486c-bee1-3d2be5c50d79 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:45.752997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1081/2136] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:45 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:45.757367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3305-553b-480b-a06d-0454d0ed0880 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:45.768726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3305-553b-480b-a06d-0454d0ed0880 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:45.773531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c7e30-9985-48f2-b80a-009245319b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:45.774173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c7e30-9985-48f2-b80a-009245319b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:45.774447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c7e30-9985-48f2-b80a-009245319b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:45.774720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c7e30-9985-48f2-b80a-009245319b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:45.775378 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c7e30-9985-48f2-b80a-009245319b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:45.777053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c7e30-9985-48f2-b80a-009245319b2b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:45.788981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1056/2137] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:45.793352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1c99-29ff-486c-bee1-3d2be5c50d79 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:45.805139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1c99-29ff-486c-bee1-3d2be5c50d79 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:45.810476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01474c-6c74-4da3-83d4-3dcabdbc3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:45.811142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01474c-6c74-4da3-83d4-3dcabdbc3f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:45.811417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01474c-6c74-4da3-83d4-3dcabdbc3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:45.811683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01474c-6c74-4da3-83d4-3dcabdbc3f36 admin admin] PATH_INFO: `/v3/projects/59d9839473a447c8b12e3f62702ba189/users/3f8d5bd68288484b92e6c5957b9a9ae2/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:45.830186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01474c-6c74-4da3-83d4-3dcabdbc3f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d9839473a447c8b12e3f62702ba189, user_id=3f8d5bd68288484b92e6c5957b9a9ae2, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:45.833031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01474c-6c74-4da3-83d4-3dcabdbc3f36 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:45.849543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1082/2138] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:45 2022] PUT /identity/v3/projects/59d9839473a447c8b12e3f62702ba189/users/3f8d5bd68288484b92e6c5957b9a9ae2/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:45.855057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c7e30-9985-48f2-b80a-009245319b2b admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:45.865910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c7e30-9985-48f2-b80a-009245319b2b admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:45.929707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5390c-a6f9-405e-8b0b-5dee6f58c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:45.930325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5390c-a6f9-405e-8b0b-5dee6f58c822 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:45.930603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5390c-a6f9-405e-8b0b-5dee6f58c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:45.930866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5390c-a6f9-405e-8b0b-5dee6f58c822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:45.931516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5390c-a6f9-405e-8b0b-5dee6f58c822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:45.933339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5390c-a6f9-405e-8b0b-5dee6f58c822 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:45.947124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1057/2139] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:45.948477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01474c-6c74-4da3-83d4-3dcabdbc3f36 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:45.960130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01474c-6c74-4da3-83d4-3dcabdbc3f36 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:45.965366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb453570-64a9-44ba-bbe7-bee828c3d754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:45.966020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb453570-64a9-44ba-bbe7-bee828c3d754 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:45.966294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb453570-64a9-44ba-bbe7-bee828c3d754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:45.966584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb453570-64a9-44ba-bbe7-bee828c3d754 admin admin] PATH_INFO: `/v3/projects/59d9839473a447c8b12e3f62702ba189/users/3f8d5bd68288484b92e6c5957b9a9ae2/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:45.968841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb453570-64a9-44ba-bbe7-bee828c3d754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d9839473a447c8b12e3f62702ba189, user_id=3f8d5bd68288484b92e6c5957b9a9ae2, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:45.971519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb453570-64a9-44ba-bbe7-bee828c3d754 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:45.983023 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1083/2140] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:45 2022] PUT /identity/v3/projects/59d9839473a447c8b12e3f62702ba189/users/3f8d5bd68288484b92e6c5957b9a9ae2/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:51.630887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f53b64-0502-4cdb-98da-d977d35fdcd8 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:51.631759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f53b64-0502-4cdb-98da-d977d35fdcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:51.632076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f53b64-0502-4cdb-98da-d977d35fdcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:51.689712 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-79f53b64-0502-4cdb-98da-d977d35fdcd8 None None] MFA Rules not processed for user `3f8d5bd68288484b92e6c5957b9a9ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:51.691482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-79f53b64-0502-4cdb-98da-d977d35fdcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:51.715380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:51.799461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1058/2141] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:51.813553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb453570-64a9-44ba-bbe7-bee828c3d754 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:51.815673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-fb453570-64a9-44ba-bbe7-bee828c3d754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:51.943199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb453570-64a9-44ba-bbe7-bee828c3d754 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:51.952762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e3f3b-6106-47c1-9b2f-d9992d738dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:51.953531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3f3b-6106-47c1-9b2f-d9992d738dba service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:51.953919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3f3b-6106-47c1-9b2f-d9992d738dba service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:51.954190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3f3b-6106-47c1-9b2f-d9992d738dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:52.056615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e3f3b-6106-47c1-9b2f-d9992d738dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:52.058357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e3f3b-6106-47c1-9b2f-d9992d738dba service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:52.062986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:52.071274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1084/2142] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:52.772156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f53b64-0502-4cdb-98da-d977d35fdcd8 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:52.900844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f53b64-0502-4cdb-98da-d977d35fdcd8 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:52.907521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd6536-f071-4667-992e-61b324f1b7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:52.909668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6536-f071-4667-992e-61b324f1b7cf service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:52.910044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6536-f071-4667-992e-61b324f1b7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:52.910520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6536-f071-4667-992e-61b324f1b7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:53.014180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd6536-f071-4667-992e-61b324f1b7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:53.015731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd6536-f071-4667-992e-61b324f1b7cf service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:53.041225 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1059/2143] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:53.660377 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292970-f15c-4bc9-b1c6-0dc7a745ed7d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:53.661095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292970-f15c-4bc9-b1c6-0dc7a745ed7d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:53.661095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292970-f15c-4bc9-b1c6-0dc7a745ed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:53.680244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d6292970-f15c-4bc9-b1c6-0dc7a745ed7d None None] MFA Rules not processed for user `7198bde056f148778f52346c3ecedfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:53.681619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d6292970-f15c-4bc9-b1c6-0dc7a745ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:53.689261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1085/2144] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:28:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:03.032982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=70 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:03.674598 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:08.369091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a48dd7-0405-4f6c-b369-86382fed5f67 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:08.369923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a48dd7-0405-4f6c-b369-86382fed5f67 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:08.370201 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a48dd7-0405-4f6c-b369-86382fed5f67 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:08.371559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1060/2145] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:29:08.389026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78817b-4442-4905-ba9d-f60fd2ba5c09 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:08.389575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78817b-4442-4905-ba9d-f60fd2ba5c09 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:08.389575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78817b-4442-4905-ba9d-f60fd2ba5c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:08.411413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ab78817b-4442-4905-ba9d-f60fd2ba5c09 None None] MFA Rules not processed for user `d09ca68fdd5b4e178bcd6a5c8bccc4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:08.413420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ab78817b-4442-4905-ba9d-f60fd2ba5c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:08.454104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a48dd7-0405-4f6c-b369-86382fed5f67 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:08.456199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d6a48dd7-0405-4f6c-b369-86382fed5f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:08.494054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1086/2146] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:29:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:08.506879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32c8ff-ab40-49cd-9f77-090ab5fc73d2 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:08.507647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32c8ff-ab40-49cd-9f77-090ab5fc73d2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:08.508038 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32c8ff-ab40-49cd-9f77-090ab5fc73d2 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:08.509752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1087/2147] 10.222.0.49 () {54 vars in 961 bytes} [Fri Sep 16 19:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:29:08.514220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d50558-e7a8-4e2a-b19f-feba0e3d8c42 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:08.514494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d50558-e7a8-4e2a-b19f-feba0e3d8c42 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:08.514765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d50558-e7a8-4e2a-b19f-feba0e3d8c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:08.536974 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-45d50558-e7a8-4e2a-b19f-feba0e3d8c42 None None] MFA Rules not processed for user `d09ca68fdd5b4e178bcd6a5c8bccc4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:08.538436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-45d50558-e7a8-4e2a-b19f-feba0e3d8c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:08.544350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a48dd7-0405-4f6c-b369-86382fed5f67 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:08.547633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1088/2148] 10.222.0.49 () {58 vars in 1058 bytes} [Fri Sep 16 19:29:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:29:08.556286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:08.557219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:08.557496 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:08.557764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] PATH_INFO: `/v3/users/4160745043014f238450385a02367db7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:08.558984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4160745043014f238450385a02367db7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:08.560452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d50558-e7a8-4e2a-b19f-feba0e3d8c42 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:08.561298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:08.570261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d50558-e7a8-4e2a-b19f-feba0e3d8c42 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:08.580138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b6726-31a9-43fb-83e4-aeae55373a89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:08.580971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b6726-31a9-43fb-83e4-aeae55373a89 service placement] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:08.581307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b6726-31a9-43fb-83e4-aeae55373a89 service placement] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:08.581693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b6726-31a9-43fb-83e4-aeae55373a89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:08.591693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b6726-31a9-43fb-83e4-aeae55373a89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:08.593415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b6726-31a9-43fb-83e4-aeae55373a89 service placement] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:08.603494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1089/2149] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:29:08.628186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4160745043014f238450385a02367db7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:08.628920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4160745043014f238450385a02367db7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:08.636727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4160745043014f238450385a02367db7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:08.648436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4160745043014f238450385a02367db7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:08.649206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-bfa3e4de-97d4-4cea-82cf-74797f50d9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4160745043014f238450385a02367db7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:08.664546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1061/2150] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:29:08 2022] DELETE /identity/v3/users/4160745043014f238450385a02367db7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:29:08.855366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b6726-31a9-43fb-83e4-aeae55373a89 service placement] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:08.868159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b6726-31a9-43fb-83e4-aeae55373a89 service placement] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:08.932154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:08.932772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:08.933054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:08.933331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] PATH_INFO: `/v3/projects/233a5a65caee4bc3be172bbd02c4efff` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:08.934504 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=233a5a65caee4bc3be172bbd02c4efff)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:08.936513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:08.992331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233a5a65caee4bc3be172bbd02c4efff', 'request_id': 'req-70646358-5945-4b65-92c2-74de5f083edb'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:08.998588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233a5a65caee4bc3be172bbd02c4efff', 'request_id': 'req-70646358-5945-4b65-92c2-74de5f083edb'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:09.004726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233a5a65caee4bc3be172bbd02c4efff', 'request_id': 'req-70646358-5945-4b65-92c2-74de5f083edb'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:09.020674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] The token cache is being invalidate because project 233a5a65caee4bc3be172bbd02c4efff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:29:09.020973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:09.021597 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-70646358-5945-4b65-92c2-74de5f083edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:09.023208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1090/2151] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:29:08 2022] DELETE /identity/v3/projects/233a5a65caee4bc3be172bbd02c4efff => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:09.028238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904da04-9511-4f38-96be-28defdacc141 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:09.028572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904da04-9511-4f38-96be-28defdacc141 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:09.028867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904da04-9511-4f38-96be-28defdacc141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:09.049555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e904da04-9511-4f38-96be-28defdacc141 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:09.050743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e904da04-9511-4f38-96be-28defdacc141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:09.111733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1062/2152] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:09.121536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba1a06-43b5-49b7-83c5-0162e0225e46 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:09.121823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba1a06-43b5-49b7-83c5-0162e0225e46 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:09.122096 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba1a06-43b5-49b7-83c5-0162e0225e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:09.138280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:09.144675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8eba1a06-43b5-49b7-83c5-0162e0225e46 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:09.146902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8eba1a06-43b5-49b7-83c5-0162e0225e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:09.155927 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1091/2153] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:09.160230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904da04-9511-4f38-96be-28defdacc141 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:09.170422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904da04-9511-4f38-96be-28defdacc141 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:09.176237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc9f7e-bdcc-4af2-bd5b-da637676dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:09.176872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc9f7e-bdcc-4af2-bd5b-da637676dabf admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:09.177147 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc9f7e-bdcc-4af2-bd5b-da637676dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:09.177411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc9f7e-bdcc-4af2-bd5b-da637676dabf admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:09.178165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc9f7e-bdcc-4af2-bd5b-da637676dabf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:29:09.178462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc9f7e-bdcc-4af2-bd5b-da637676dabf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:09.180092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc9f7e-bdcc-4af2-bd5b-da637676dabf admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:09.192094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1063/2154] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:29:09.196370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba1a06-43b5-49b7-83c5-0162e0225e46 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:09.206114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba1a06-43b5-49b7-83c5-0162e0225e46 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:09.212171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91ee29-8d4d-414b-a69e-ea992327558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:09.212807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91ee29-8d4d-414b-a69e-ea992327558e admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:09.213059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91ee29-8d4d-414b-a69e-ea992327558e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:09.213345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91ee29-8d4d-414b-a69e-ea992327558e admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:09.213977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91ee29-8d4d-414b-a69e-ea992327558e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:09.215904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91ee29-8d4d-414b-a69e-ea992327558e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:09.245562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1092/2155] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:29:09 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:29:09.250155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc9f7e-bdcc-4af2-bd5b-da637676dabf admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:09.261573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc9f7e-bdcc-4af2-bd5b-da637676dabf admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:09.265673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:09.326806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf7aa2-4a3a-455a-b027-1f00570c1df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:09.327418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf7aa2-4a3a-455a-b027-1f00570c1df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:09.327704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf7aa2-4a3a-455a-b027-1f00570c1df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:09.327972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf7aa2-4a3a-455a-b027-1f00570c1df6 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:09.328732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf7aa2-4a3a-455a-b027-1f00570c1df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:09.330679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf7aa2-4a3a-455a-b027-1f00570c1df6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:09.356965 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1064/2156] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:29:09 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:29:09.361518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91ee29-8d4d-414b-a69e-ea992327558e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:09.371965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91ee29-8d4d-414b-a69e-ea992327558e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:09.376829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada766f-8b58-4940-8635-9095c3d438bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:09.377422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada766f-8b58-4940-8635-9095c3d438bf admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:09.377700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada766f-8b58-4940-8635-9095c3d438bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:09.377971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada766f-8b58-4940-8635-9095c3d438bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:09.378609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada766f-8b58-4940-8635-9095c3d438bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:09.380212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada766f-8b58-4940-8635-9095c3d438bf admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:09.391266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1093/2157] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:29:09.395572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf7aa2-4a3a-455a-b027-1f00570c1df6 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:09.405800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf7aa2-4a3a-455a-b027-1f00570c1df6 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:09.410563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75331781-0397-4a59-8d66-f80ceabbd6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:09.411154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75331781-0397-4a59-8d66-f80ceabbd6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:09.411427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75331781-0397-4a59-8d66-f80ceabbd6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:09.411694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75331781-0397-4a59-8d66-f80ceabbd6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:09.412507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75331781-0397-4a59-8d66-f80ceabbd6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:09.414216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75331781-0397-4a59-8d66-f80ceabbd6d3 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:09.424964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1065/2158] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:29:09.429308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada766f-8b58-4940-8635-9095c3d438bf admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:09.440770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada766f-8b58-4940-8635-9095c3d438bf admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:09.446739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b441e-ce96-4a24-ac91-74e4f7017071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:09.447319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b441e-ce96-4a24-ac91-74e4f7017071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:09.447951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b441e-ce96-4a24-ac91-74e4f7017071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:09.448226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b441e-ce96-4a24-ac91-74e4f7017071 admin admin] PATH_INFO: `/v3/projects/0fb3b84f2fd54e3084311ec3086f7b7a/users/386a0c1ed2744030b62b54e9ff0c9010/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:09.463738 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b441e-ce96-4a24-ac91-74e4f7017071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb3b84f2fd54e3084311ec3086f7b7a, user_id=386a0c1ed2744030b62b54e9ff0c9010, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:09.466468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b441e-ce96-4a24-ac91-74e4f7017071 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:09.485550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1094/2159] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:29:09 2022] PUT /identity/v3/projects/0fb3b84f2fd54e3084311ec3086f7b7a/users/386a0c1ed2744030b62b54e9ff0c9010/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:09.503291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a6afe-052f-4eb3-b62f-78a32c8b8e3f None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:09.503596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a6afe-052f-4eb3-b62f-78a32c8b8e3f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:09.503977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a6afe-052f-4eb3-b62f-78a32c8b8e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:09.534257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4c5a6afe-052f-4eb3-b62f-78a32c8b8e3f None None] MFA Rules not processed for user `386a0c1ed2744030b62b54e9ff0c9010`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:09.535608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4c5a6afe-052f-4eb3-b62f-78a32c8b8e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:09.632471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1066/2160] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:09.644877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b441e-ce96-4a24-ac91-74e4f7017071 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:09.647115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c13b441e-ce96-4a24-ac91-74e4f7017071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:09.721495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b441e-ce96-4a24-ac91-74e4f7017071 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:09.727926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd3e51-26f4-4365-a878-67816107fb9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:09.728580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3e51-26f4-4365-a878-67816107fb9a service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:09.728858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3e51-26f4-4365-a878-67816107fb9a service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:09.729127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3e51-26f4-4365-a878-67816107fb9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:09.737753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd3e51-26f4-4365-a878-67816107fb9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:09.739425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd3e51-26f4-4365-a878-67816107fb9a service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:09.749519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1095/2161] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:29:15.066913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a6afe-052f-4eb3-b62f-78a32c8b8e3f None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:15.068494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4c5a6afe-052f-4eb3-b62f-78a32c8b8e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:15.145930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a6afe-052f-4eb3-b62f-78a32c8b8e3f None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:15.150806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:15.151466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:15.151836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:15.152111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] PATH_INFO: `/v3/users/a41e13dce33048e883452fef20d91552` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:15.153303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41e13dce33048e883452fef20d91552)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:15.155253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:15.172569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:15.207103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41e13dce33048e883452fef20d91552'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:15.207748 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41e13dce33048e883452fef20d91552'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:15.214641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41e13dce33048e883452fef20d91552'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:15.226406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41e13dce33048e883452fef20d91552'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:15.227067 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41e13dce33048e883452fef20d91552'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:15.242149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1067/2162] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:29:15 2022] DELETE /identity/v3/users/a41e13dce33048e883452fef20d91552 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:15.247179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92e7c2-71ad-4bf2-b3d9-7c9228174388 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:15.247672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92e7c2-71ad-4bf2-b3d9-7c9228174388 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:15.247764 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92e7c2-71ad-4bf2-b3d9-7c9228174388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:15.266910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ad92e7c2-71ad-4bf2-b3d9-7c9228174388 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:15.268138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ad92e7c2-71ad-4bf2-b3d9-7c9228174388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:15.327371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1096/2163] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:15.337628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:15.339229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:15.405045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e80f-705b-40fc-a84f-e22cff785ceb admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:15.408874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a9516-15b3-48e1-8e95-0284a2a43900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:15.409581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a9516-15b3-48e1-8e95-0284a2a43900 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:15.409768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a9516-15b3-48e1-8e95-0284a2a43900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:15.410025 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a9516-15b3-48e1-8e95-0284a2a43900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:15.428691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a9516-15b3-48e1-8e95-0284a2a43900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:15.428691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a9516-15b3-48e1-8e95-0284a2a43900 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:15.436721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1068/2164] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:29:15.833280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92e7c2-71ad-4bf2-b3d9-7c9228174388 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:15.834907 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ad92e7c2-71ad-4bf2-b3d9-7c9228174388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:15.848805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92e7c2-71ad-4bf2-b3d9-7c9228174388 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:15.853908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:15.855257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:15.855541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:15.855816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] PATH_INFO: `/v3/projects/2470f64d267049d68e9bbba9d6d0275c` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:15.857089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2470f64d267049d68e9bbba9d6d0275c)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:15.859112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:15.885594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:15.911352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2470f64d267049d68e9bbba9d6d0275c', 'request_id': 'req-b6e68728-2a69-4e27-af81-f2ce71a3270c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:15.917856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2470f64d267049d68e9bbba9d6d0275c', 'request_id': 'req-b6e68728-2a69-4e27-af81-f2ce71a3270c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:15.924966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2470f64d267049d68e9bbba9d6d0275c', 'request_id': 'req-b6e68728-2a69-4e27-af81-f2ce71a3270c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:15.938278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] The token cache is being invalidate because project 2470f64d267049d68e9bbba9d6d0275c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:29:15.938569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:15.939185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:15.940775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1097/2165] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:29:15 2022] DELETE /identity/v3/projects/2470f64d267049d68e9bbba9d6d0275c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:15.945166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a9516-15b3-48e1-8e95-0284a2a43900 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:15.956121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a9516-15b3-48e1-8e95-0284a2a43900 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:16.014993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:16.015635 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:16.015913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:16.016189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] PATH_INFO: `/v3/users/4c40df4d392342509a0b52153e910e0b` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:16.017345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c40df4d392342509a0b52153e910e0b)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:16.019293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:16.077925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:16.085556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c40df4d392342509a0b52153e910e0b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.086688 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c40df4d392342509a0b52153e910e0b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.094519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c40df4d392342509a0b52153e910e0b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.106185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c40df4d392342509a0b52153e910e0b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.106840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c40df4d392342509a0b52153e910e0b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.120896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1069/2166] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:29:15 2022] DELETE /identity/v3/users/4c40df4d392342509a0b52153e910e0b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:16.615561 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:16.617316 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:16.637611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e68728-2a69-4e27-af81-f2ce71a3270c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:16.694145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:16.694777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:16.695055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:16.695325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] PATH_INFO: `/v3/projects/d264071099cf4c71b05762188adbe1e4` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:16.697118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d264071099cf4c71b05762188adbe1e4)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:16.699306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:16.755835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd264071099cf4c71b05762188adbe1e4', 'request_id': 'req-1760549a-ea2f-4d46-8dc3-e5b2ae843911'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.766825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:16.766825 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:16.776421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd264071099cf4c71b05762188adbe1e4', 'request_id': 'req-1760549a-ea2f-4d46-8dc3-e5b2ae843911'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.783168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b4262-f60a-4c99-94d5-e2881d886a15 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:16.785701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd264071099cf4c71b05762188adbe1e4', 'request_id': 'req-1760549a-ea2f-4d46-8dc3-e5b2ae843911'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.801891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] The token cache is being invalidate because project d264071099cf4c71b05762188adbe1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:29:16.802181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.803086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1760549a-ea2f-4d46-8dc3-e5b2ae843911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.804579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1098/2167] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:29:16 2022] DELETE /identity/v3/projects/d264071099cf4c71b05762188adbe1e4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:16.810181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8de5-29bc-4c44-97cb-8efedd61bba2 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:16.810462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8de5-29bc-4c44-97cb-8efedd61bba2 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:16.810734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8de5-29bc-4c44-97cb-8efedd61bba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:16.835721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-956e8de5-29bc-4c44-97cb-8efedd61bba2 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:16.838545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-956e8de5-29bc-4c44-97cb-8efedd61bba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:16.852479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:16.853199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:16.853577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:16.853918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] PATH_INFO: `/v3/users/386a0c1ed2744030b62b54e9ff0c9010` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:16.855210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=386a0c1ed2744030b62b54e9ff0c9010)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:16.857599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:16.886519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:16.917929 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1099/2168] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:29:16.928899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64afa0-fd1d-4ff8-80e0-9a873d29cedc None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:16.929233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64afa0-fd1d-4ff8-80e0-9a873d29cedc None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:16.929457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64afa0-fd1d-4ff8-80e0-9a873d29cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:16.929783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386a0c1ed2744030b62b54e9ff0c9010'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.937942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386a0c1ed2744030b62b54e9ff0c9010'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.947897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386a0c1ed2744030b62b54e9ff0c9010'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.955536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5f64afa0-fd1d-4ff8-80e0-9a873d29cedc None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:16.956815 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5f64afa0-fd1d-4ff8-80e0-9a873d29cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:16.960956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386a0c1ed2744030b62b54e9ff0c9010'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.961862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e18ae7e3-e26f-4b63-a8d0-3188e4c9d6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386a0c1ed2744030b62b54e9ff0c9010'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:16.965150 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1100/2169] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:16.970028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64afa0-fd1d-4ff8-80e0-9a873d29cedc None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:16.976877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1070/2170] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:29:16 2022] DELETE /identity/v3/users/386a0c1ed2744030b62b54e9ff0c9010 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:16.979583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64afa0-fd1d-4ff8-80e0-9a873d29cedc None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:16.981525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46689eeb-24f6-49a9-a49d-ec03cb10da89 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:16.981830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46689eeb-24f6-49a9-a49d-ec03cb10da89 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:16.982100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46689eeb-24f6-49a9-a49d-ec03cb10da89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.000994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-46689eeb-24f6-49a9-a49d-ec03cb10da89 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:17.002189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-46689eeb-24f6-49a9-a49d-ec03cb10da89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:17.033171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:17.042385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3b0ce-26ea-449a-9171-d8fc465602b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.043568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b0ce-26ea-449a-9171-d8fc465602b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.043840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b0ce-26ea-449a-9171-d8fc465602b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.044253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b0ce-26ea-449a-9171-d8fc465602b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.045089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3b0ce-26ea-449a-9171-d8fc465602b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:29:17.045415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3b0ce-26ea-449a-9171-d8fc465602b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.050649 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3b0ce-26ea-449a-9171-d8fc465602b9 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.061117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1101/2171] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:29:17.065577 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1071/2172] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:29:17.068407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3b0ce-26ea-449a-9171-d8fc465602b9 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.075705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46689eeb-24f6-49a9-a49d-ec03cb10da89 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.077069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-46689eeb-24f6-49a9-a49d-ec03cb10da89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:17.079252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3b0ce-26ea-449a-9171-d8fc465602b9 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:17.085424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103944a-0f80-4dea-868c-7b15c8233eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.086067 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103944a-0f80-4dea-868c-7b15c8233eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.086351 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103944a-0f80-4dea-868c-7b15c8233eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.086640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103944a-0f80-4dea-868c-7b15c8233eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.087287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103944a-0f80-4dea-868c-7b15c8233eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.089367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103944a-0f80-4dea-868c-7b15c8233eb2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.121549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1102/2173] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:29:17 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:29:17.125876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103944a-0f80-4dea-868c-7b15c8233eb2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.135806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46689eeb-24f6-49a9-a49d-ec03cb10da89 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:17.185229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74135f-d4cf-4d49-b97e-386d091a1d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.185837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74135f-d4cf-4d49-b97e-386d091a1d33 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.186110 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74135f-d4cf-4d49-b97e-386d091a1d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.186496 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74135f-d4cf-4d49-b97e-386d091a1d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.191116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103944a-0f80-4dea-868c-7b15c8233eb2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:17.195490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74135f-d4cf-4d49-b97e-386d091a1d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.195867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6836-2cc6-4d98-b18e-71b09211fbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.196610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6836-2cc6-4d98-b18e-71b09211fbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.196895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6836-2cc6-4d98-b18e-71b09211fbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.197077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74135f-d4cf-4d49-b97e-386d091a1d33 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.197178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6836-2cc6-4d98-b18e-71b09211fbb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.197798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a6836-2cc6-4d98-b18e-71b09211fbb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.200034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a6836-2cc6-4d98-b18e-71b09211fbb2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.206554 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1072/2174] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:29:17.221935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1103/2175] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:29:17 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:29:17.225918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74135f-d4cf-4d49-b97e-386d091a1d33 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.236178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74135f-d4cf-4d49-b97e-386d091a1d33 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:17.240781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b603117-7609-4855-88ed-1b709d7b6d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.241404 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b603117-7609-4855-88ed-1b709d7b6d05 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.241674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b603117-7609-4855-88ed-1b709d7b6d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.241941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b603117-7609-4855-88ed-1b709d7b6d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.242685 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b603117-7609-4855-88ed-1b709d7b6d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.244486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b603117-7609-4855-88ed-1b709d7b6d05 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.255140 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1073/2176] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:29:17.259908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6836-2cc6-4d98-b18e-71b09211fbb2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.271000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6836-2cc6-4d98-b18e-71b09211fbb2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:17.278427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0be343-a866-46ad-841b-9a7e28dadd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.279182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0be343-a866-46ad-841b-9a7e28dadd34 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.279471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0be343-a866-46ad-841b-9a7e28dadd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.279766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0be343-a866-46ad-841b-9a7e28dadd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.280498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0be343-a866-46ad-841b-9a7e28dadd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.282476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0be343-a866-46ad-841b-9a7e28dadd34 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.298742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1104/2177] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:29:17.299822 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b603117-7609-4855-88ed-1b709d7b6d05 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.312621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b603117-7609-4855-88ed-1b709d7b6d05 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:17.318596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbe570-983d-4adb-9bbf-33a2f9aae18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.319271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbe570-983d-4adb-9bbf-33a2f9aae18c admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.319553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbe570-983d-4adb-9bbf-33a2f9aae18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.319827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbe570-983d-4adb-9bbf-33a2f9aae18c admin admin] PATH_INFO: `/v3/projects/22b32ee2137441f693f646376b5fe1dd/users/1b83f6d186824562ad551c765cce246b/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.336563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbe570-983d-4adb-9bbf-33a2f9aae18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b32ee2137441f693f646376b5fe1dd, user_id=1b83f6d186824562ad551c765cce246b, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.339408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbe570-983d-4adb-9bbf-33a2f9aae18c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.357332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1074/2178] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:29:17 2022] PUT /identity/v3/projects/22b32ee2137441f693f646376b5fe1dd/users/1b83f6d186824562ad551c765cce246b/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:29:17.369584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cecc50-a36c-4470-8273-826993181e65 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.369867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cecc50-a36c-4470-8273-826993181e65 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.370383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cecc50-a36c-4470-8273-826993181e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.413993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-65cecc50-a36c-4470-8273-826993181e65 None None] MFA Rules not processed for user `1b83f6d186824562ad551c765cce246b`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:17.413993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-65cecc50-a36c-4470-8273-826993181e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:17.423924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:17.484934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1105/2179] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:17.503561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbe570-983d-4adb-9bbf-33a2f9aae18c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.506665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-81fbe570-983d-4adb-9bbf-33a2f9aae18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:17.520194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cecc50-a36c-4470-8273-826993181e65 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.522001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-65cecc50-a36c-4470-8273-826993181e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:17.591417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbe570-983d-4adb-9bbf-33a2f9aae18c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:17.595622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c78538-28eb-4b8f-b8bb-7cd9b2f822c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f83a7e0c14541788c92e3d96b839077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.596239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c78538-28eb-4b8f-b8bb-7cd9b2f822c0 service glance] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.596553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c78538-28eb-4b8f-b8bb-7cd9b2f822c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.596828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c78538-28eb-4b8f-b8bb-7cd9b2f822c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.605503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cecc50-a36c-4470-8273-826993181e65 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:17.605659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c78538-28eb-4b8f-b8bb-7cd9b2f822c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.606986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c78538-28eb-4b8f-b8bb-7cd9b2f822c0 service glance] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.610114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.610815 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.611086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.611355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] PATH_INFO: `/v3/projects/0fb3b84f2fd54e3084311ec3086f7b7a` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.613052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb3b84f2fd54e3084311ec3086f7b7a)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.614980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.616632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1075/2180] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:29:17.664705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb3b84f2fd54e3084311ec3086f7b7a', 'request_id': 'req-2bfeef37-f2c7-4c38-b1db-64396f98cb02'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:17.671512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb3b84f2fd54e3084311ec3086f7b7a', 'request_id': 'req-2bfeef37-f2c7-4c38-b1db-64396f98cb02'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:17.677356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb3b84f2fd54e3084311ec3086f7b7a', 'request_id': 'req-2bfeef37-f2c7-4c38-b1db-64396f98cb02'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:17.691446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] The token cache is being invalidate because project 0fb3b84f2fd54e3084311ec3086f7b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:29:17.691742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:17.692606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-2bfeef37-f2c7-4c38-b1db-64396f98cb02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:17.694307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1106/2181] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:29:17 2022] DELETE /identity/v3/projects/0fb3b84f2fd54e3084311ec3086f7b7a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:17.699230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abfe36-d49c-48b2-8198-6c11de6c6af9 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.699568 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abfe36-d49c-48b2-8198-6c11de6c6af9 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.699844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abfe36-d49c-48b2-8198-6c11de6c6af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.707630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:17.726076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-b5abfe36-d49c-48b2-8198-6c11de6c6af9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:17.728136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b5abfe36-d49c-48b2-8198-6c11de6c6af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:17.806507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1076/2182] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:29:17.814601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56763-a1f8-4e30-85ea-b425d5ddcb6e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.814886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56763-a1f8-4e30-85ea-b425d5ddcb6e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.815159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56763-a1f8-4e30-85ea-b425d5ddcb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.835327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6ee56763-a1f8-4e30-85ea-b425d5ddcb6e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:17.836571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6ee56763-a1f8-4e30-85ea-b425d5ddcb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:17.845186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1107/2183] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:17.849579 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abfe36-d49c-48b2-8198-6c11de6c6af9 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.859614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abfe36-d49c-48b2-8198-6c11de6c6af9 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:17.864721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17dad1-1da7-4709-8978-59392dd451f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.865379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17dad1-1da7-4709-8978-59392dd451f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.865660 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17dad1-1da7-4709-8978-59392dd451f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.865930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17dad1-1da7-4709-8978-59392dd451f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.866672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17dad1-1da7-4709-8978-59392dd451f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:29:17.866977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17dad1-1da7-4709-8978-59392dd451f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.868651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17dad1-1da7-4709-8978-59392dd451f9 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.880859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1077/2184] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:29:17.886044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee56763-a1f8-4e30-85ea-b425d5ddcb6e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.895749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee56763-a1f8-4e30-85ea-b425d5ddcb6e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:17.900810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde5888-bd8c-4368-8907-39407c5cc63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:17.901578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde5888-bd8c-4368-8907-39407c5cc63d admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:17.901945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde5888-bd8c-4368-8907-39407c5cc63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:17.902620 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde5888-bd8c-4368-8907-39407c5cc63d admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:17.903362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde5888-bd8c-4368-8907-39407c5cc63d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:17.905526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde5888-bd8c-4368-8907-39407c5cc63d admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:17.950031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1108/2185] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:29:17 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:29:17.954677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17dad1-1da7-4709-8978-59392dd451f9 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:17.968410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17dad1-1da7-4709-8978-59392dd451f9 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.031500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a780c8-c3e5-465a-8c9a-3a78f10a2aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.032473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a780c8-c3e5-465a-8c9a-3a78f10a2aef admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.032590 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a780c8-c3e5-465a-8c9a-3a78f10a2aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.032851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a780c8-c3e5-465a-8c9a-3a78f10a2aef admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.033729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a780c8-c3e5-465a-8c9a-3a78f10a2aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:18.035791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a780c8-c3e5-465a-8c9a-3a78f10a2aef admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:18.067405 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1078/2186] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:29:17 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:29:18.067955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde5888-bd8c-4368-8907-39407c5cc63d admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:18.082860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde5888-bd8c-4368-8907-39407c5cc63d admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.088619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffe4a4-4f72-4c54-b646-3d698facc295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.089439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffe4a4-4f72-4c54-b646-3d698facc295 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.090013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffe4a4-4f72-4c54-b646-3d698facc295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.090389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffe4a4-4f72-4c54-b646-3d698facc295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.091241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffe4a4-4f72-4c54-b646-3d698facc295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:18.093636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffe4a4-4f72-4c54-b646-3d698facc295 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:18.106983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1109/2187] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:29:18.110951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a780c8-c3e5-465a-8c9a-3a78f10a2aef admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:18.123129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a780c8-c3e5-465a-8c9a-3a78f10a2aef admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.129064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5365997-1a29-46f7-99f8-f3eb9bc4e761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.129790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5365997-1a29-46f7-99f8-f3eb9bc4e761 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.130137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5365997-1a29-46f7-99f8-f3eb9bc4e761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.130480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5365997-1a29-46f7-99f8-f3eb9bc4e761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.131200 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5365997-1a29-46f7-99f8-f3eb9bc4e761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:18.133312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5365997-1a29-46f7-99f8-f3eb9bc4e761 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:18.146890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1079/2188] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:29:18.151278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffe4a4-4f72-4c54-b646-3d698facc295 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:18.162120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffe4a4-4f72-4c54-b646-3d698facc295 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.167288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557acfb-95ec-4c40-854d-fb8e5e9ba914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.167963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557acfb-95ec-4c40-854d-fb8e5e9ba914 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.168237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557acfb-95ec-4c40-854d-fb8e5e9ba914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.168564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557acfb-95ec-4c40-854d-fb8e5e9ba914 admin admin] PATH_INFO: `/v3/projects/76f9210e62da460ba68f315cec76937a/users/481bddcdb9bf410b849228da706bf7b5/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.170893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:18.186047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557acfb-95ec-4c40-854d-fb8e5e9ba914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f9210e62da460ba68f315cec76937a, user_id=481bddcdb9bf410b849228da706bf7b5, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:18.189063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557acfb-95ec-4c40-854d-fb8e5e9ba914 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:18.204104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1110/2189] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:29:18 2022] PUT /identity/v3/projects/76f9210e62da460ba68f315cec76937a/users/481bddcdb9bf410b849228da706bf7b5/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:18.214821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17e440-33c2-44ec-b3f6-e347bd933b45 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.215124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17e440-33c2-44ec-b3f6-e347bd933b45 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.215397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17e440-33c2-44ec-b3f6-e347bd933b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.243654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-da17e440-33c2-44ec-b3f6-e347bd933b45 None None] MFA Rules not processed for user `481bddcdb9bf410b849228da706bf7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:18.244894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-da17e440-33c2-44ec-b3f6-e347bd933b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:18.306251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:18.316010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1080/2190] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:18.317369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557acfb-95ec-4c40-854d-fb8e5e9ba914 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:18.388031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557acfb-95ec-4c40-854d-fb8e5e9ba914 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.393041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9927-7342-453a-abfe-78915bb3a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.393674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9927-7342-453a-abfe-78915bb3a4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.393891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9927-7342-453a-abfe-78915bb3a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.394181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9927-7342-453a-abfe-78915bb3a4d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.394837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b9927-7342-453a-abfe-78915bb3a4d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:18.396879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b9927-7342-453a-abfe-78915bb3a4d3 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:18.428831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1111/2191] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:29:18 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:29:18.432629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17e440-33c2-44ec-b3f6-e347bd933b45 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:18.444062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17e440-33c2-44ec-b3f6-e347bd933b45 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.508514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6f79-ddcc-4c34-9eec-35205de97ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.509142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6f79-ddcc-4c34-9eec-35205de97ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.509424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6f79-ddcc-4c34-9eec-35205de97ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.509736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6f79-ddcc-4c34-9eec-35205de97ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.510420 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa6f79-ddcc-4c34-9eec-35205de97ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:18.512621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa6f79-ddcc-4c34-9eec-35205de97ae2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:18.543759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1081/2192] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:29:18 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:29:18.544898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9927-7342-453a-abfe-78915bb3a4d3 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:18.557573 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9927-7342-453a-abfe-78915bb3a4d3 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.563520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41d76-c37e-4d4a-830a-d6da637c0872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.564628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41d76-c37e-4d4a-830a-d6da637c0872 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.564851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41d76-c37e-4d4a-830a-d6da637c0872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.565219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41d76-c37e-4d4a-830a-d6da637c0872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.566271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41d76-c37e-4d4a-830a-d6da637c0872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:18.568777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41d76-c37e-4d4a-830a-d6da637c0872 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:18.584429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1112/2193] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:29:18.586837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6f79-ddcc-4c34-9eec-35205de97ae2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:18.598009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6f79-ddcc-4c34-9eec-35205de97ae2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.604239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ecc8b-1379-405a-9b35-555622b92384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.605315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ecc8b-1379-405a-9b35-555622b92384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.605592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ecc8b-1379-405a-9b35-555622b92384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.605863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ecc8b-1379-405a-9b35-555622b92384 admin admin] PATH_INFO: `/v3/projects/9ef1ced2f35548c4bbf6f32b1dc478a2/users/131a1d47f4f9425a82744e752f6b47bf/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.623442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ecc8b-1379-405a-9b35-555622b92384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef1ced2f35548c4bbf6f32b1dc478a2, user_id=131a1d47f4f9425a82744e752f6b47bf, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:18.626215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ecc8b-1379-405a-9b35-555622b92384 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:18.642944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1082/2194] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:29:18 2022] PUT /identity/v3/projects/9ef1ced2f35548c4bbf6f32b1dc478a2/users/131a1d47f4f9425a82744e752f6b47bf/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:18.647144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41d76-c37e-4d4a-830a-d6da637c0872 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:18.657803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41d76-c37e-4d4a-830a-d6da637c0872 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.720031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a860264-99dd-43ce-aa28-5791a4245e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.720772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a860264-99dd-43ce-aa28-5791a4245e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.720931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a860264-99dd-43ce-aa28-5791a4245e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.721215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a860264-99dd-43ce-aa28-5791a4245e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.721885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a860264-99dd-43ce-aa28-5791a4245e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:18.723515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a860264-99dd-43ce-aa28-5791a4245e01 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:18.733883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1113/2195] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:29:18.738321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ecc8b-1379-405a-9b35-555622b92384 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:18.749970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ecc8b-1379-405a-9b35-555622b92384 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.759493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a8401-f958-41e6-9211-285dfb5e4b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.760432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8401-f958-41e6-9211-285dfb5e4b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.760801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8401-f958-41e6-9211-285dfb5e4b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.761075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8401-f958-41e6-9211-285dfb5e4b45 admin admin] PATH_INFO: `/v3/projects/9ef1ced2f35548c4bbf6f32b1dc478a2/users/131a1d47f4f9425a82744e752f6b47bf/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.763683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a8401-f958-41e6-9211-285dfb5e4b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef1ced2f35548c4bbf6f32b1dc478a2, user_id=131a1d47f4f9425a82744e752f6b47bf, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:18.766382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a8401-f958-41e6-9211-285dfb5e4b45 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:18.781546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1083/2196] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:29:18 2022] PUT /identity/v3/projects/9ef1ced2f35548c4bbf6f32b1dc478a2/users/131a1d47f4f9425a82744e752f6b47bf/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:18.794191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e16a53-8e8e-4adf-af38-87cd14585a6d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:18.794527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e16a53-8e8e-4adf-af38-87cd14585a6d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:18.794796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e16a53-8e8e-4adf-af38-87cd14585a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:18.826608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-75e16a53-8e8e-4adf-af38-87cd14585a6d None None] MFA Rules not processed for user `131a1d47f4f9425a82744e752f6b47bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:18.827865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-75e16a53-8e8e-4adf-af38-87cd14585a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:18.873537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:18.913338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1114/2197] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:18.925654 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a8401-f958-41e6-9211-285dfb5e4b45 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:18.928302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b42a8401-f958-41e6-9211-285dfb5e4b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:18.995446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a8401-f958-41e6-9211-285dfb5e4b45 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:18.999139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b154d4a-ac2c-4648-9d39-4618ad74a7ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:18.999894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154d4a-ac2c-4648-9d39-4618ad74a7ec service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:19.000169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154d4a-ac2c-4648-9d39-4618ad74a7ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:19.000465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154d4a-ac2c-4648-9d39-4618ad74a7ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:19.010384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b154d4a-ac2c-4648-9d39-4618ad74a7ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:19.011884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b154d4a-ac2c-4648-9d39-4618ad74a7ec service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:19.021709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1084/2198] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:29:19.101940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e16a53-8e8e-4adf-af38-87cd14585a6d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:19.112150 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e16a53-8e8e-4adf-af38-87cd14585a6d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:19.116580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91e63e-8e14-4ef3-8d9c-f274a4376304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:19.117238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e63e-8e14-4ef3-8d9c-f274a4376304 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:19.117505 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e63e-8e14-4ef3-8d9c-f274a4376304 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:19.117768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e63e-8e14-4ef3-8d9c-f274a4376304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:19.186138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91e63e-8e14-4ef3-8d9c-f274a4376304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:19.187591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91e63e-8e14-4ef3-8d9c-f274a4376304 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:19.196747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1115/2199] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:29:19.582368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b154d4a-ac2c-4648-9d39-4618ad74a7ec service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:19.584374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7b154d4a-ac2c-4648-9d39-4618ad74a7ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:19.648364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:19.664182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b154d4a-ac2c-4648-9d39-4618ad74a7ec service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:19.671634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:19.672290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:19.672754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:19.673034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] PATH_INFO: `/v3/users/63ab5a2b9ffe4a8199678d9cc7fe51f4` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:19.674300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ab5a2b9ffe4a8199678d9cc7fe51f4)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:19.676420 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:19.730173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ab5a2b9ffe4a8199678d9cc7fe51f4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:19.730803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ab5a2b9ffe4a8199678d9cc7fe51f4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:19.739835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ab5a2b9ffe4a8199678d9cc7fe51f4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:19.753646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ab5a2b9ffe4a8199678d9cc7fe51f4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:19.754466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ab5a2b9ffe4a8199678d9cc7fe51f4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:19.771533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1085/2200] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:29:19 2022] DELETE /identity/v3/users/63ab5a2b9ffe4a8199678d9cc7fe51f4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:19.777236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add018ae-2bb6-4201-a251-5494d9c991dc None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:19.777713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add018ae-2bb6-4201-a251-5494d9c991dc None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:19.777844 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add018ae-2bb6-4201-a251-5494d9c991dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:19.802406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-add018ae-2bb6-4201-a251-5494d9c991dc None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:19.803694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-add018ae-2bb6-4201-a251-5494d9c991dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:19.872463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1116/2201] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:19.884783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:19.886719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:19.955493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d02984-8ca1-4a71-83f2-9cd510e8fdea admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:19.959537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fab3fe-cd76-4e02-a358-73a328579754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:19.960170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fab3fe-cd76-4e02-a358-73a328579754 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:19.960612 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fab3fe-cd76-4e02-a358-73a328579754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:19.960941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fab3fe-cd76-4e02-a358-73a328579754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:19.973043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fab3fe-cd76-4e02-a358-73a328579754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:19.974514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fab3fe-cd76-4e02-a358-73a328579754 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:19.984598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1086/2202] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:29:20.271925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add018ae-2bb6-4201-a251-5494d9c991dc None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:20.273510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-add018ae-2bb6-4201-a251-5494d9c991dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:20.286565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add018ae-2bb6-4201-a251-5494d9c991dc None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:20.291961 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:20.295806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:20.296098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:20.296399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] PATH_INFO: `/v3/projects/c85be1765393416c92df2787ec0e62a7` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:20.301415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85be1765393416c92df2787ec0e62a7)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:20.303473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:20.356418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85be1765393416c92df2787ec0e62a7', 'request_id': 'req-0662bdf1-ad6c-4332-a71a-a5026c8c1913'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:20.364042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85be1765393416c92df2787ec0e62a7', 'request_id': 'req-0662bdf1-ad6c-4332-a71a-a5026c8c1913'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:20.373304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85be1765393416c92df2787ec0e62a7', 'request_id': 'req-0662bdf1-ad6c-4332-a71a-a5026c8c1913'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:20.387535 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:20.393266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] The token cache is being invalidate because project c85be1765393416c92df2787ec0e62a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:29:20.393266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:20.393888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-0662bdf1-ad6c-4332-a71a-a5026c8c1913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:20.398113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1117/2203] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:29:20 2022] DELETE /identity/v3/projects/c85be1765393416c92df2787ec0e62a7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:20.403427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fc5ce-816e-4228-bcc7-28c2b5ceab1a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:20.403755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fc5ce-816e-4228-bcc7-28c2b5ceab1a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:20.404141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fc5ce-816e-4228-bcc7-28c2b5ceab1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:20.429792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-9e6fc5ce-816e-4228-bcc7-28c2b5ceab1a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:20.431049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9e6fc5ce-816e-4228-bcc7-28c2b5ceab1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:20.512599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1087/2204] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:20.524348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724ca8-06b2-43e8-89d6-791567e2a52a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:20.524921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724ca8-06b2-43e8-89d6-791567e2a52a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:20.525205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724ca8-06b2-43e8-89d6-791567e2a52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:20.564064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-83724ca8-06b2-43e8-89d6-791567e2a52a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:20.565372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-83724ca8-06b2-43e8-89d6-791567e2a52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:20.575331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1118/2205] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:29:20.579637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fc5ce-816e-4228-bcc7-28c2b5ceab1a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:20.589248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fc5ce-816e-4228-bcc7-28c2b5ceab1a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:20.595153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39aee1-9043-4f20-8851-bfbd74aca514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:20.595857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39aee1-9043-4f20-8851-bfbd74aca514 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:20.596204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39aee1-9043-4f20-8851-bfbd74aca514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:20.596615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39aee1-9043-4f20-8851-bfbd74aca514 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:20.597347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39aee1-9043-4f20-8851-bfbd74aca514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:29:20.597862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39aee1-9043-4f20-8851-bfbd74aca514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:20.599610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39aee1-9043-4f20-8851-bfbd74aca514 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:20.616437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1088/2206] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:29:20.618860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83724ca8-06b2-43e8-89d6-791567e2a52a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:20.630060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83724ca8-06b2-43e8-89d6-791567e2a52a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:20.635845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191412e7-de48-4a35-bb60-c2264d1ca60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:20.636635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191412e7-de48-4a35-bb60-c2264d1ca60a admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:20.637034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191412e7-de48-4a35-bb60-c2264d1ca60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:20.637416 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191412e7-de48-4a35-bb60-c2264d1ca60a admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:20.638066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191412e7-de48-4a35-bb60-c2264d1ca60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:20.640199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191412e7-de48-4a35-bb60-c2264d1ca60a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:20.680430 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1119/2207] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:29:20 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:29:20.683563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39aee1-9043-4f20-8851-bfbd74aca514 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:20.690672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:20.697588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39aee1-9043-4f20-8851-bfbd74aca514 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:20.779402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981f7da-3f76-4235-acaa-7f4871567135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:20.780541 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981f7da-3f76-4235-acaa-7f4871567135 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:20.781007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981f7da-3f76-4235-acaa-7f4871567135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:20.781455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981f7da-3f76-4235-acaa-7f4871567135 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:20.782341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981f7da-3f76-4235-acaa-7f4871567135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:20.784589 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981f7da-3f76-4235-acaa-7f4871567135 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:20.816427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1089/2208] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:29:20 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:29:20.819679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191412e7-de48-4a35-bb60-c2264d1ca60a admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:20.832355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191412e7-de48-4a35-bb60-c2264d1ca60a admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:20.850334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c340a2-46e0-4373-be7c-792468f761b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:20.851242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c340a2-46e0-4373-be7c-792468f761b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:20.851521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c340a2-46e0-4373-be7c-792468f761b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:20.851788 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c340a2-46e0-4373-be7c-792468f761b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:20.852475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c340a2-46e0-4373-be7c-792468f761b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:20.854444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c340a2-46e0-4373-be7c-792468f761b3 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:20.866516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1120/2209] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:29:20.870912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981f7da-3f76-4235-acaa-7f4871567135 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:20.882032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981f7da-3f76-4235-acaa-7f4871567135 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:20.887578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19010a-9dae-4644-b13e-7da7205da66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:20.888170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19010a-9dae-4644-b13e-7da7205da66a admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:20.888490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19010a-9dae-4644-b13e-7da7205da66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:20.888747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19010a-9dae-4644-b13e-7da7205da66a admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:20.889388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19010a-9dae-4644-b13e-7da7205da66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:20.891004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19010a-9dae-4644-b13e-7da7205da66a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:20.902319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1090/2210] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:29:20.907289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c340a2-46e0-4373-be7c-792468f761b3 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:20.918720 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c340a2-46e0-4373-be7c-792468f761b3 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:20.924800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24418ee-524b-4d2c-a51e-10459a8c74ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:20.925467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24418ee-524b-4d2c-a51e-10459a8c74ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:20.925747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24418ee-524b-4d2c-a51e-10459a8c74ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:20.926026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24418ee-524b-4d2c-a51e-10459a8c74ff admin admin] PATH_INFO: `/v3/projects/5e73312bb07e4837be51d239efb3b0b0/users/926f9f25a9b349e6bd3fe442ca6cbe47/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:20.941875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24418ee-524b-4d2c-a51e-10459a8c74ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e73312bb07e4837be51d239efb3b0b0, user_id=926f9f25a9b349e6bd3fe442ca6cbe47, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:20.944631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24418ee-524b-4d2c-a51e-10459a8c74ff admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:20.960551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1121/2211] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:29:20 2022] PUT /identity/v3/projects/5e73312bb07e4837be51d239efb3b0b0/users/926f9f25a9b349e6bd3fe442ca6cbe47/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:20.971193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c9397-be19-480f-a2b3-090e322b6257 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:20.971550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c9397-be19-480f-a2b3-090e322b6257 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:20.971827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c9397-be19-480f-a2b3-090e322b6257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:21.001233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2c4c9397-be19-480f-a2b3-090e322b6257 None None] MFA Rules not processed for user `926f9f25a9b349e6bd3fe442ca6cbe47`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:21.002485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2c4c9397-be19-480f-a2b3-090e322b6257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:21.080345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1091/2212] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:21.092137 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24418ee-524b-4d2c-a51e-10459a8c74ff admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:21.094306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f24418ee-524b-4d2c-a51e-10459a8c74ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:21.154582 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24418ee-524b-4d2c-a51e-10459a8c74ff admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:21.158827 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d7acf-ee38-441f-802d-a547c55fc9a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:21.159443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7acf-ee38-441f-802d-a547c55fc9a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:21.159711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7acf-ee38-441f-802d-a547c55fc9a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:21.159979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7acf-ee38-441f-802d-a547c55fc9a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:21.170396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d7acf-ee38-441f-802d-a547c55fc9a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:21.171859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d7acf-ee38-441f-802d-a547c55fc9a5 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:21.181500 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1122/2213] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:29:31.077015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:31.177130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:34.400800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c9397-be19-480f-a2b3-090e322b6257 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:34.467062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c9397-be19-480f-a2b3-090e322b6257 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:34.471980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:34.472710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:34.472984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:34.473239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] PATH_INFO: `/v3/users/926f9f25a9b349e6bd3fe442ca6cbe47` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:34.474388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926f9f25a9b349e6bd3fe442ca6cbe47)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:34.476322 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:34.541012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926f9f25a9b349e6bd3fe442ca6cbe47'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:34.541674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926f9f25a9b349e6bd3fe442ca6cbe47'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:34.548953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926f9f25a9b349e6bd3fe442ca6cbe47'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:34.562800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926f9f25a9b349e6bd3fe442ca6cbe47'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:34.563543 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926f9f25a9b349e6bd3fe442ca6cbe47'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:34.579338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1092/2214] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:29:34 2022] DELETE /identity/v3/users/926f9f25a9b349e6bd3fe442ca6cbe47 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:34.584286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed938f62-23ae-410a-a54a-9372c173244a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:34.584814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed938f62-23ae-410a-a54a-9372c173244a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:34.585099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed938f62-23ae-410a-a54a-9372c173244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:34.604722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ed938f62-23ae-410a-a54a-9372c173244a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:34.605991 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ed938f62-23ae-410a-a54a-9372c173244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:34.673313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1123/2215] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:34.683042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:34.684913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:34.754525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbff581-0d5a-4eac-9dbe-c2ce64f9f206 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:34.759933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651dd46-9ed0-4f7e-915d-a2acc8a7278e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:34.760162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651dd46-9ed0-4f7e-915d-a2acc8a7278e service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:34.760494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651dd46-9ed0-4f7e-915d-a2acc8a7278e service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:34.760769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651dd46-9ed0-4f7e-915d-a2acc8a7278e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:34.772873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651dd46-9ed0-4f7e-915d-a2acc8a7278e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:34.774411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651dd46-9ed0-4f7e-915d-a2acc8a7278e service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:34.785761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1093/2216] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:29:35.071317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed938f62-23ae-410a-a54a-9372c173244a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:35.073115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ed938f62-23ae-410a-a54a-9372c173244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:35.088639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed938f62-23ae-410a-a54a-9372c173244a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:35.094462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:35.095259 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:35.095542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:35.095817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] PATH_INFO: `/v3/projects/5e73312bb07e4837be51d239efb3b0b0` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:35.097057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e73312bb07e4837be51d239efb3b0b0)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:35.099144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:35.155441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e73312bb07e4837be51d239efb3b0b0', 'request_id': 'req-3f237b48-c91a-4467-a886-e9ba2f681de0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:35.161751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e73312bb07e4837be51d239efb3b0b0', 'request_id': 'req-3f237b48-c91a-4467-a886-e9ba2f681de0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:35.167817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e73312bb07e4837be51d239efb3b0b0', 'request_id': 'req-3f237b48-c91a-4467-a886-e9ba2f681de0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:35.182394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] The token cache is being invalidate because project 5e73312bb07e4837be51d239efb3b0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:29:35.182690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:35.183392 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-3f237b48-c91a-4467-a886-e9ba2f681de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:35.192598 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1124/2217] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:29:35 2022] DELETE /identity/v3/projects/5e73312bb07e4837be51d239efb3b0b0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:44.781018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:45.178750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:50.301559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651dd46-9ed0-4f7e-915d-a2acc8a7278e service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:50.303068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a651dd46-9ed0-4f7e-915d-a2acc8a7278e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:50.316775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651dd46-9ed0-4f7e-915d-a2acc8a7278e service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:50.377225 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:50.377754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:50.378029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:50.378296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] PATH_INFO: `/v3/users/1b83f6d186824562ad551c765cce246b` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:50.379869 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b83f6d186824562ad551c765cce246b)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:50.381917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:50.432479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b83f6d186824562ad551c765cce246b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:50.433178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b83f6d186824562ad551c765cce246b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:50.440997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b83f6d186824562ad551c765cce246b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:50.454070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b83f6d186824562ad551c765cce246b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:50.454880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b83f6d186824562ad551c765cce246b'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:50.471117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1094/2218] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:29:50 2022] DELETE /identity/v3/users/1b83f6d186824562ad551c765cce246b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:50.476106 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a015-1ec7-46e7-a8df-1956d6ef1f10 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:50.476645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a015-1ec7-46e7-a8df-1956d6ef1f10 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:50.476739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a015-1ec7-46e7-a8df-1956d6ef1f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:50.498998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-14e7a015-1ec7-46e7-a8df-1956d6ef1f10 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:50.500226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-14e7a015-1ec7-46e7-a8df-1956d6ef1f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:50.563044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1125/2219] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:50.573535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:50.575061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:50.637370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814c49-f651-448d-bd08-4e3f5e7ee285 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:50.641315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ddb12-6825-452d-b28f-2d9b4c8c7da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:50.641917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ddb12-6825-452d-b28f-2d9b4c8c7da9 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:50.642197 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ddb12-6825-452d-b28f-2d9b4c8c7da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:50.642492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ddb12-6825-452d-b28f-2d9b4c8c7da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:50.651771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ddb12-6825-452d-b28f-2d9b4c8c7da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:50.653265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ddb12-6825-452d-b28f-2d9b4c8c7da9 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:50.663498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1095/2220] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:29:50.957139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7a015-1ec7-46e7-a8df-1956d6ef1f10 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:50.958762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-14e7a015-1ec7-46e7-a8df-1956d6ef1f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:50.971294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7a015-1ec7-46e7-a8df-1956d6ef1f10 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:50.976546 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:50.977193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:50.977471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:50.977732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] PATH_INFO: `/v3/projects/22b32ee2137441f693f646376b5fe1dd` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:50.978893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b32ee2137441f693f646376b5fe1dd)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:50.980867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:51.029707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b32ee2137441f693f646376b5fe1dd', 'request_id': 'req-30d3d174-7e98-429f-a902-8f4e5b4228d2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:51.036170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b32ee2137441f693f646376b5fe1dd', 'request_id': 'req-30d3d174-7e98-429f-a902-8f4e5b4228d2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:51.043000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b32ee2137441f693f646376b5fe1dd', 'request_id': 'req-30d3d174-7e98-429f-a902-8f4e5b4228d2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:51.058064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] The token cache is being invalidate because project 22b32ee2137441f693f646376b5fe1dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:29:51.058404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:51.059026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-30d3d174-7e98-429f-a902-8f4e5b4228d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:29:51.060612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1126/2221] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:29:50 2022] DELETE /identity/v3/projects/22b32ee2137441f693f646376b5fe1dd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:51.065663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd6445-60e6-488f-a611-7f1aa76029e5 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:51.065971 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd6445-60e6-488f-a611-7f1aa76029e5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:51.066242 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd6445-60e6-488f-a611-7f1aa76029e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:51.086608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-dbdd6445-60e6-488f-a611-7f1aa76029e5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:51.087795 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-dbdd6445-60e6-488f-a611-7f1aa76029e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:51.104821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:51.150732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1096/2222] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:51.158753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b48e-e450-466d-a59f-fa94e8fd1b64 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:51.159079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b48e-e450-466d-a59f-fa94e8fd1b64 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:51.159378 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b48e-e450-466d-a59f-fa94e8fd1b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:51.179554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4258b48e-e450-466d-a59f-fa94e8fd1b64 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:51.180792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4258b48e-e450-466d-a59f-fa94e8fd1b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:51.190224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1127/2223] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:51.194719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd6445-60e6-488f-a611-7f1aa76029e5 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:51.204847 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd6445-60e6-488f-a611-7f1aa76029e5 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:51.210402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b7a6a-eec8-4575-9f12-2a2e1c8fce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:51.211009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b7a6a-eec8-4575-9f12-2a2e1c8fce64 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:51.211288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b7a6a-eec8-4575-9f12-2a2e1c8fce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:51.211557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b7a6a-eec8-4575-9f12-2a2e1c8fce64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:51.212212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b7a6a-eec8-4575-9f12-2a2e1c8fce64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:29:51.213153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b7a6a-eec8-4575-9f12-2a2e1c8fce64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:51.214800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b7a6a-eec8-4575-9f12-2a2e1c8fce64 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:51.227892 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1097/2224] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:29:51.232873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258b48e-e450-466d-a59f-fa94e8fd1b64 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:51.243321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258b48e-e450-466d-a59f-fa94e8fd1b64 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:51.249237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0d8d2-271c-4c90-9fb9-c44734e0a514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:51.249835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0d8d2-271c-4c90-9fb9-c44734e0a514 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:51.250106 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0d8d2-271c-4c90-9fb9-c44734e0a514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:51.250368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0d8d2-271c-4c90-9fb9-c44734e0a514 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:51.251002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0d8d2-271c-4c90-9fb9-c44734e0a514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:51.253680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0d8d2-271c-4c90-9fb9-c44734e0a514 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:51.284631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1128/2225] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:29:51 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:29:51.289017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b7a6a-eec8-4575-9f12-2a2e1c8fce64 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:51.299837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b7a6a-eec8-4575-9f12-2a2e1c8fce64 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:51.376621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d24b0-88e9-4eb4-b93d-377d5afe56ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:51.377419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d24b0-88e9-4eb4-b93d-377d5afe56ad admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:51.377636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d24b0-88e9-4eb4-b93d-377d5afe56ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:51.377820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d24b0-88e9-4eb4-b93d-377d5afe56ad admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:51.378458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d24b0-88e9-4eb4-b93d-377d5afe56ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:51.381591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d24b0-88e9-4eb4-b93d-377d5afe56ad admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:51.410249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1098/2226] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:29:51 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:29:51.414667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0d8d2-271c-4c90-9fb9-c44734e0a514 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:51.431819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0d8d2-271c-4c90-9fb9-c44734e0a514 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:51.439805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3511ada-06d7-468d-bc16-40f0a2f4a7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:51.440477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3511ada-06d7-468d-bc16-40f0a2f4a7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:51.440764 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3511ada-06d7-468d-bc16-40f0a2f4a7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:51.441025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3511ada-06d7-468d-bc16-40f0a2f4a7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:51.441977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3511ada-06d7-468d-bc16-40f0a2f4a7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:51.443611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3511ada-06d7-468d-bc16-40f0a2f4a7cc admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:51.456470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1129/2227] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:29:51.460639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d24b0-88e9-4eb4-b93d-377d5afe56ad admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:51.471556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d24b0-88e9-4eb4-b93d-377d5afe56ad admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:51.486114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55195a0-3370-48e8-8a66-28c31d8b79c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:51.487075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55195a0-3370-48e8-8a66-28c31d8b79c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:51.487487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55195a0-3370-48e8-8a66-28c31d8b79c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:51.487903 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55195a0-3370-48e8-8a66-28c31d8b79c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:51.489156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55195a0-3370-48e8-8a66-28c31d8b79c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:51.491052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55195a0-3370-48e8-8a66-28c31d8b79c2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:51.505761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1099/2228] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:29:51.509731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3511ada-06d7-468d-bc16-40f0a2f4a7cc admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:51.522866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3511ada-06d7-468d-bc16-40f0a2f4a7cc admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:51.529588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e72519-5e68-4b58-9768-640c5d73552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:51.530269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e72519-5e68-4b58-9768-640c5d73552e admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:51.530547 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e72519-5e68-4b58-9768-640c5d73552e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:51.530819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e72519-5e68-4b58-9768-640c5d73552e admin admin] PATH_INFO: `/v3/projects/fc60d4648fbf48e0b690c8f08cd287e5/users/0173abc992a2402eb854a3bdfe0fd54d/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:51.570829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e72519-5e68-4b58-9768-640c5d73552e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc60d4648fbf48e0b690c8f08cd287e5, user_id=0173abc992a2402eb854a3bdfe0fd54d, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:51.574420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e72519-5e68-4b58-9768-640c5d73552e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:51.597162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1130/2229] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:29:51 2022] PUT /identity/v3/projects/fc60d4648fbf48e0b690c8f08cd287e5/users/0173abc992a2402eb854a3bdfe0fd54d/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:29:51.608709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aad2d-7727-4ef9-8cda-aff29da007d4 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:51.609086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aad2d-7727-4ef9-8cda-aff29da007d4 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:51.609421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aad2d-7727-4ef9-8cda-aff29da007d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:51.642861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-8c6aad2d-7727-4ef9-8cda-aff29da007d4 None None] MFA Rules not processed for user `0173abc992a2402eb854a3bdfe0fd54d`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:29:51.644196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8c6aad2d-7727-4ef9-8cda-aff29da007d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:51.751235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1100/2230] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:29:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:29:51.763557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e72519-5e68-4b58-9768-640c5d73552e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:29:51.765526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a1e72519-5e68-4b58-9768-640c5d73552e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:29:51.789593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:51.837270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e72519-5e68-4b58-9768-640c5d73552e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:29:51.841125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f79c3e-366b-46db-8510-8bb260368a94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f83a7e0c14541788c92e3d96b839077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:29:51.841744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f79c3e-366b-46db-8510-8bb260368a94 service glance] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:29:51.842045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f79c3e-366b-46db-8510-8bb260368a94 service glance] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:29:51.842303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f79c3e-366b-46db-8510-8bb260368a94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:29:51.851334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f79c3e-366b-46db-8510-8bb260368a94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:29:51.852826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f79c3e-366b-46db-8510-8bb260368a94 service glance] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:29:51.862209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1131/2231] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:29:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:01.747488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:01.857898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=17 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:07.525515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6aad2d-7727-4ef9-8cda-aff29da007d4 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:07.527166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8c6aad2d-7727-4ef9-8cda-aff29da007d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:07.545659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f79c3e-366b-46db-8510-8bb260368a94 service glance] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:07.546847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-27f79c3e-366b-46db-8510-8bb260368a94 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:07.637627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6aad2d-7727-4ef9-8cda-aff29da007d4 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:07.642549 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887bd6a-b362-4d1e-958d-1de5b5137efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:07.643265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887bd6a-b362-4d1e-958d-1de5b5137efb service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:07.643696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887bd6a-b362-4d1e-958d-1de5b5137efb service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:07.644038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887bd6a-b362-4d1e-958d-1de5b5137efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:07.646967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b887bd6a-b362-4d1e-958d-1de5b5137efb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:07.685375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f79c3e-366b-46db-8510-8bb260368a94 service glance] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:07.691202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18661040-54cf-44f5-973c-96064dd7ad65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:07.692171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18661040-54cf-44f5-973c-96064dd7ad65 service placement] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:07.693159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18661040-54cf-44f5-973c-96064dd7ad65 service placement] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:07.693838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18661040-54cf-44f5-973c-96064dd7ad65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:07.700643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-18661040-54cf-44f5-973c-96064dd7ad65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:07.716772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18661040-54cf-44f5-973c-96064dd7ad65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:07.718935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18661040-54cf-44f5-973c-96064dd7ad65 service placement] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:07.740261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1132/2232] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:07.766984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887bd6a-b362-4d1e-958d-1de5b5137efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:07.766984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887bd6a-b362-4d1e-958d-1de5b5137efb service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:07.774709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1101/2233] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:09.967352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a88d-9da1-4775-9bd2-2811427d5422 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:09.967909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a88d-9da1-4775-9bd2-2811427d5422 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:09.967909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a88d-9da1-4775-9bd2-2811427d5422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:09.990724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-a447a88d-9da1-4775-9bd2-2811427d5422 None None] MFA Rules not processed for user `e4681e0753e84aea8d453465a424e2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:09.991966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a447a88d-9da1-4775-9bd2-2811427d5422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:10.050941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1133/2234] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:17.770165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=50 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:18.581262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887bd6a-b362-4d1e-958d-1de5b5137efb service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:18.582815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b887bd6a-b362-4d1e-958d-1de5b5137efb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:18.653435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887bd6a-b362-4d1e-958d-1de5b5137efb service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:18.658662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:18.659311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:18.659592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:18.659863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] PATH_INFO: `/v3/users/481bddcdb9bf410b849228da706bf7b5` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:18.661020 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=481bddcdb9bf410b849228da706bf7b5)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:18.663223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:18.713518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481bddcdb9bf410b849228da706bf7b5'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:18.714224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481bddcdb9bf410b849228da706bf7b5'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:18.721966 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481bddcdb9bf410b849228da706bf7b5'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:18.734273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481bddcdb9bf410b849228da706bf7b5'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:18.734989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481bddcdb9bf410b849228da706bf7b5'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:18.750564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1102/2235] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:18 2022] DELETE /identity/v3/users/481bddcdb9bf410b849228da706bf7b5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:18.755603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dc2a6-03c1-4922-9eaf-56197564e63d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:18.756202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dc2a6-03c1-4922-9eaf-56197564e63d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:18.756202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dc2a6-03c1-4922-9eaf-56197564e63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:18.776832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5f3dc2a6-03c1-4922-9eaf-56197564e63d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:18.778082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5f3dc2a6-03c1-4922-9eaf-56197564e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:18.845588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1134/2236] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:18.855701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:18.857263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:18.917335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9d987-a59b-4f57-93ff-41a023785fdf admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:18.921712 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a628c-b55d-450f-ad76-ca942bb537dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:18.922345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a628c-b55d-450f-ad76-ca942bb537dd service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:18.922677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a628c-b55d-450f-ad76-ca942bb537dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:18.922949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a628c-b55d-450f-ad76-ca942bb537dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:18.933868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a628c-b55d-450f-ad76-ca942bb537dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:18.935312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a628c-b55d-450f-ad76-ca942bb537dd service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:18.945558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1103/2237] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:19.233235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dc2a6-03c1-4922-9eaf-56197564e63d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:19.234725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5f3dc2a6-03c1-4922-9eaf-56197564e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:19.247500 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dc2a6-03c1-4922-9eaf-56197564e63d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:19.253804 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:19.254603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:19.254949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:19.255282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] PATH_INFO: `/v3/projects/76f9210e62da460ba68f315cec76937a` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:19.256645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f9210e62da460ba68f315cec76937a)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:19.259292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:19.296658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:19.311376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f9210e62da460ba68f315cec76937a', 'request_id': 'req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.317996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f9210e62da460ba68f315cec76937a', 'request_id': 'req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.324439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f9210e62da460ba68f315cec76937a', 'request_id': 'req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.339113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] The token cache is being invalidate because project 76f9210e62da460ba68f315cec76937a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:19.339401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.340025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.341574 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1135/2238] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:19 2022] DELETE /identity/v3/projects/76f9210e62da460ba68f315cec76937a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:19.345714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a628c-b55d-450f-ad76-ca942bb537dd service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:19.355891 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a628c-b55d-450f-ad76-ca942bb537dd service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:19.375633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:19.419133 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:19.419765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:19.420042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:19.420315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] PATH_INFO: `/v3/users/131a1d47f4f9425a82744e752f6b47bf` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:19.421525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131a1d47f4f9425a82744e752f6b47bf)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:19.423463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:19.476952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131a1d47f4f9425a82744e752f6b47bf'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.477778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131a1d47f4f9425a82744e752f6b47bf'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.486054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131a1d47f4f9425a82744e752f6b47bf'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.499079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131a1d47f4f9425a82744e752f6b47bf'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.499743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d9cafa88-c6bc-4323-bfed-0925bbcb0334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131a1d47f4f9425a82744e752f6b47bf'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.513837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1104/2239] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:19 2022] DELETE /identity/v3/users/131a1d47f4f9425a82744e752f6b47bf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:19.797719 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:19.799266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:19.815227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bf215-ca1b-4cab-ade0-8da60b96c3cb admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:19.872114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:19.872777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:19.873054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:19.873319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] PATH_INFO: `/v3/projects/9ef1ced2f35548c4bbf6f32b1dc478a2` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:19.874466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef1ced2f35548c4bbf6f32b1dc478a2)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:19.876397 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:19.931916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef1ced2f35548c4bbf6f32b1dc478a2', 'request_id': 'req-634d208c-51c0-42de-a093-ea170763506c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.938203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef1ced2f35548c4bbf6f32b1dc478a2', 'request_id': 'req-634d208c-51c0-42de-a093-ea170763506c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.944102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef1ced2f35548c4bbf6f32b1dc478a2', 'request_id': 'req-634d208c-51c0-42de-a093-ea170763506c'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.962009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] The token cache is being invalidate because project 9ef1ced2f35548c4bbf6f32b1dc478a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:19.962291 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.962931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-634d208c-51c0-42de-a093-ea170763506c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:19.964476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1136/2240] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:19 2022] DELETE /identity/v3/projects/9ef1ced2f35548c4bbf6f32b1dc478a2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:19.969529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44662-804f-48af-8be2-062c26ec2dc1 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:19.970027 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44662-804f-48af-8be2-062c26ec2dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:19.970123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44662-804f-48af-8be2-062c26ec2dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:19.990094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-1ef44662-804f-48af-8be2-062c26ec2dc1 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:19.991293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-1ef44662-804f-48af-8be2-062c26ec2dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:20.053625 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1105/2241] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:20.062996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc563c6-2c97-4370-8dc4-5b39214871b3 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.063279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc563c6-2c97-4370-8dc4-5b39214871b3 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.063555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc563c6-2c97-4370-8dc4-5b39214871b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.084725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5bc563c6-2c97-4370-8dc4-5b39214871b3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:20.085966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5bc563c6-2c97-4370-8dc4-5b39214871b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:20.095721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1137/2242] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:20.100410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44662-804f-48af-8be2-062c26ec2dc1 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.111033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44662-804f-48af-8be2-062c26ec2dc1 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.115952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7759d2-08d2-4f22-a1ca-f27ccf2f3f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.116653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7759d2-08d2-4f22-a1ca-f27ccf2f3f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.116907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7759d2-08d2-4f22-a1ca-f27ccf2f3f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.117313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7759d2-08d2-4f22-a1ca-f27ccf2f3f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.117891 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7759d2-08d2-4f22-a1ca-f27ccf2f3f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:30:20.118196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7759d2-08d2-4f22-a1ca-f27ccf2f3f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.119953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7759d2-08d2-4f22-a1ca-f27ccf2f3f8a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.133829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1106/2243] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:30:20.138355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc563c6-2c97-4370-8dc4-5b39214871b3 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.147843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc563c6-2c97-4370-8dc4-5b39214871b3 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.153553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ff806-0c4e-4322-9ec3-8e624c115bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.154168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ff806-0c4e-4322-9ec3-8e624c115bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.154446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ff806-0c4e-4322-9ec3-8e624c115bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.154716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ff806-0c4e-4322-9ec3-8e624c115bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.155363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ff806-0c4e-4322-9ec3-8e624c115bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.157342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ff806-0c4e-4322-9ec3-8e624c115bd0 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.195009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1138/2244] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:20 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:20.199327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7759d2-08d2-4f22-a1ca-f27ccf2f3f8a admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.209459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7759d2-08d2-4f22-a1ca-f27ccf2f3f8a admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.238570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:20.275487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8e4a7-d5a5-418d-8506-e4dfcbc85bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.276104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8e4a7-d5a5-418d-8506-e4dfcbc85bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.276399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8e4a7-d5a5-418d-8506-e4dfcbc85bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.276695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8e4a7-d5a5-418d-8506-e4dfcbc85bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.277442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8e4a7-d5a5-418d-8506-e4dfcbc85bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.279369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8e4a7-d5a5-418d-8506-e4dfcbc85bd8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.304415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1107/2245] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:20 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:20.308658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ff806-0c4e-4322-9ec3-8e624c115bd0 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.321294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ff806-0c4e-4322-9ec3-8e624c115bd0 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.326229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f51fc1-d5bf-4423-addb-f76e1d575b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.326850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51fc1-d5bf-4423-addb-f76e1d575b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.327169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51fc1-d5bf-4423-addb-f76e1d575b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.327443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51fc1-d5bf-4423-addb-f76e1d575b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.328110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f51fc1-d5bf-4423-addb-f76e1d575b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.329830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f51fc1-d5bf-4423-addb-f76e1d575b86 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.340326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1139/2246] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:20.344566 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8e4a7-d5a5-418d-8506-e4dfcbc85bd8 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.355007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8e4a7-d5a5-418d-8506-e4dfcbc85bd8 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.360053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea536-928a-47d7-810d-def250c47dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.360715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea536-928a-47d7-810d-def250c47dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.360992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea536-928a-47d7-810d-def250c47dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.361258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea536-928a-47d7-810d-def250c47dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.361900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea536-928a-47d7-810d-def250c47dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.363501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea536-928a-47d7-810d-def250c47dd8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.374459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1108/2247] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:20.379119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f51fc1-d5bf-4423-addb-f76e1d575b86 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.390065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f51fc1-d5bf-4423-addb-f76e1d575b86 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.396228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c3bf4-ea7c-409d-86a3-8dd54ef8c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.396926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c3bf4-ea7c-409d-86a3-8dd54ef8c854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.397209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c3bf4-ea7c-409d-86a3-8dd54ef8c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.397475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c3bf4-ea7c-409d-86a3-8dd54ef8c854 admin admin] PATH_INFO: `/v3/projects/35df3ff9283a4b76ba172281e8c42d61/users/e106645517f0401b8b4b8d08e3972ea8/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.400903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:20.414529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c3bf4-ea7c-409d-86a3-8dd54ef8c854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35df3ff9283a4b76ba172281e8c42d61, user_id=e106645517f0401b8b4b8d08e3972ea8, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.417252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c3bf4-ea7c-409d-86a3-8dd54ef8c854 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.433346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1140/2248] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:20 2022] PUT /identity/v3/projects/35df3ff9283a4b76ba172281e8c42d61/users/e106645517f0401b8b4b8d08e3972ea8/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:30:20.443988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d272f88-7c37-4aab-ab56-77e3957a5151 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.444269 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d272f88-7c37-4aab-ab56-77e3957a5151 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.444607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d272f88-7c37-4aab-ab56-77e3957a5151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.474145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-1d272f88-7c37-4aab-ab56-77e3957a5151 None None] MFA Rules not processed for user `e106645517f0401b8b4b8d08e3972ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:20.475338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-1d272f88-7c37-4aab-ab56-77e3957a5151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:20.546062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1109/2249] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:30:20.550863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c3bf4-ea7c-409d-86a3-8dd54ef8c854 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.613972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c3bf4-ea7c-409d-86a3-8dd54ef8c854 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.619735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc78ff-b16a-4b13-ac25-aa2342fe4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.620358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc78ff-b16a-4b13-ac25-aa2342fe4955 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.620675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc78ff-b16a-4b13-ac25-aa2342fe4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.620946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc78ff-b16a-4b13-ac25-aa2342fe4955 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.621580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc78ff-b16a-4b13-ac25-aa2342fe4955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.623515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc78ff-b16a-4b13-ac25-aa2342fe4955 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.654355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1141/2250] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:20 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:20.658744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d272f88-7c37-4aab-ab56-77e3957a5151 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.672035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d272f88-7c37-4aab-ab56-77e3957a5151 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.732771 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac9a6d-3774-454a-baab-851e1b0702a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.733400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac9a6d-3774-454a-baab-851e1b0702a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.733647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac9a6d-3774-454a-baab-851e1b0702a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.733915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac9a6d-3774-454a-baab-851e1b0702a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.734571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac9a6d-3774-454a-baab-851e1b0702a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.736508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac9a6d-3774-454a-baab-851e1b0702a3 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.761302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1110/2251] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:20 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:20.765706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc78ff-b16a-4b13-ac25-aa2342fe4955 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.777024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc78ff-b16a-4b13-ac25-aa2342fe4955 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.781866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af193-00ce-42ae-9576-d0466a3cbfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.782472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af193-00ce-42ae-9576-d0466a3cbfae admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.782751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af193-00ce-42ae-9576-d0466a3cbfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.783022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af193-00ce-42ae-9576-d0466a3cbfae admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.783667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8af193-00ce-42ae-9576-d0466a3cbfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.785335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8af193-00ce-42ae-9576-d0466a3cbfae admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.796774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1142/2252] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:20.800922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac9a6d-3774-454a-baab-851e1b0702a3 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.811138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac9a6d-3774-454a-baab-851e1b0702a3 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.816186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166822ff-bd94-429c-9995-5ee0e43b9781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.816875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166822ff-bd94-429c-9995-5ee0e43b9781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.817155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166822ff-bd94-429c-9995-5ee0e43b9781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.817441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166822ff-bd94-429c-9995-5ee0e43b9781 admin admin] PATH_INFO: `/v3/projects/ece5cad0af3b45619db39cda229ab19b/users/a377716d3a5d415ab1822727f010d3e7/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.832975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166822ff-bd94-429c-9995-5ee0e43b9781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece5cad0af3b45619db39cda229ab19b, user_id=a377716d3a5d415ab1822727f010d3e7, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.835706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166822ff-bd94-429c-9995-5ee0e43b9781 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.853710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1111/2253] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:20 2022] PUT /identity/v3/projects/ece5cad0af3b45619db39cda229ab19b/users/a377716d3a5d415ab1822727f010d3e7/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:20.857813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af193-00ce-42ae-9576-d0466a3cbfae admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.868043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af193-00ce-42ae-9576-d0466a3cbfae admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.926053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ece9ee-9976-4b84-8e7f-c7969061831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.926662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece9ee-9976-4b84-8e7f-c7969061831f admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.926942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece9ee-9976-4b84-8e7f-c7969061831f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.927215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece9ee-9976-4b84-8e7f-c7969061831f admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.927863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ece9ee-9976-4b84-8e7f-c7969061831f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.929531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ece9ee-9976-4b84-8e7f-c7969061831f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.939842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1143/2254] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:20.944173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166822ff-bd94-429c-9995-5ee0e43b9781 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:20.950180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:20.955723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166822ff-bd94-429c-9995-5ee0e43b9781 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:20.962592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86133c-3810-4aec-9c4c-ed75c95656c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:20.963268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86133c-3810-4aec-9c4c-ed75c95656c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.963551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86133c-3810-4aec-9c4c-ed75c95656c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.963828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86133c-3810-4aec-9c4c-ed75c95656c6 admin admin] PATH_INFO: `/v3/projects/ece5cad0af3b45619db39cda229ab19b/users/a377716d3a5d415ab1822727f010d3e7/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:20.965795 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86133c-3810-4aec-9c4c-ed75c95656c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece5cad0af3b45619db39cda229ab19b, user_id=a377716d3a5d415ab1822727f010d3e7, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:20.968504 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86133c-3810-4aec-9c4c-ed75c95656c6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:20.979663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1112/2255] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:20 2022] PUT /identity/v3/projects/ece5cad0af3b45619db39cda229ab19b/users/a377716d3a5d415ab1822727f010d3e7/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:20.990384 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260a6c-9c3d-4f4d-9df8-dd66f1254ece None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:20.990675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260a6c-9c3d-4f4d-9df8-dd66f1254ece None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:20.990956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260a6c-9c3d-4f4d-9df8-dd66f1254ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:21.019043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6c260a6c-9c3d-4f4d-9df8-dd66f1254ece None None] MFA Rules not processed for user `a377716d3a5d415ab1822727f010d3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:21.020264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6c260a6c-9c3d-4f4d-9df8-dd66f1254ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:21.065303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:21.093114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1144/2256] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:21.105086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86133c-3810-4aec-9c4c-ed75c95656c6 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:21.111768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2a86133c-3810-4aec-9c4c-ed75c95656c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:21.187911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86133c-3810-4aec-9c4c-ed75c95656c6 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:21.191656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61391cde-d7d7-4f8c-a20a-b78d48d10e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:21.192262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61391cde-d7d7-4f8c-a20a-b78d48d10e63 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:21.192575 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61391cde-d7d7-4f8c-a20a-b78d48d10e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:21.192846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61391cde-d7d7-4f8c-a20a-b78d48d10e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:21.202053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61391cde-d7d7-4f8c-a20a-b78d48d10e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:21.203509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61391cde-d7d7-4f8c-a20a-b78d48d10e63 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:21.213117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1113/2257] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:21.297055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c260a6c-9c3d-4f4d-9df8-dd66f1254ece None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:21.309082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c260a6c-9c3d-4f4d-9df8-dd66f1254ece None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:21.313098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4590ad-5f29-4601-9e17-545e8140d84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:21.320840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4590ad-5f29-4601-9e17-545e8140d84a service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:21.321045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4590ad-5f29-4601-9e17-545e8140d84a service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:21.321340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4590ad-5f29-4601-9e17-545e8140d84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:21.387219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4590ad-5f29-4601-9e17-545e8140d84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:21.389073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4590ad-5f29-4601-9e17-545e8140d84a service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:21.399468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1145/2258] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:24.195528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61391cde-d7d7-4f8c-a20a-b78d48d10e63 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:24.259363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61391cde-d7d7-4f8c-a20a-b78d48d10e63 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:24.264682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:24.265306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:24.265581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:24.265849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] PATH_INFO: `/v3/users/e106645517f0401b8b4b8d08e3972ea8` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:24.267001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e106645517f0401b8b4b8d08e3972ea8)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:24.268957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:24.324291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e106645517f0401b8b4b8d08e3972ea8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:24.324997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e106645517f0401b8b4b8d08e3972ea8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:24.332396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e106645517f0401b8b4b8d08e3972ea8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:24.345876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e106645517f0401b8b4b8d08e3972ea8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:24.346655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e106645517f0401b8b4b8d08e3972ea8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:24.363082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1114/2259] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:24 2022] DELETE /identity/v3/users/e106645517f0401b8b4b8d08e3972ea8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:24.368086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c6d8b-d1e9-45bf-b12c-8f4caeff3393 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:24.368627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c6d8b-d1e9-45bf-b12c-8f4caeff3393 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:24.368832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c6d8b-d1e9-45bf-b12c-8f4caeff3393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:24.389408 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-021c6d8b-d1e9-45bf-b12c-8f4caeff3393 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:24.390623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-021c6d8b-d1e9-45bf-b12c-8f4caeff3393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:24.458689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1146/2260] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:24.468777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:24.470419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:24.485747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:24.536908 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e95be-5b2f-47f7-b6c3-4740995a6a9d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:24.541149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc863b-456b-4e83-a022-bc371831b5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:24.541759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc863b-456b-4e83-a022-bc371831b5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:24.542035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc863b-456b-4e83-a022-bc371831b5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:24.542303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc863b-456b-4e83-a022-bc371831b5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:24.551806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc863b-456b-4e83-a022-bc371831b5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:24.553362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc863b-456b-4e83-a022-bc371831b5e3 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:24.564474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1115/2261] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:24.859426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c6d8b-d1e9-45bf-b12c-8f4caeff3393 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:24.860934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-021c6d8b-d1e9-45bf-b12c-8f4caeff3393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:24.877483 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c6d8b-d1e9-45bf-b12c-8f4caeff3393 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:24.891431 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:24.892256 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:24.892570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:24.892849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] PATH_INFO: `/v3/projects/35df3ff9283a4b76ba172281e8c42d61` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:24.894023 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=35df3ff9283a4b76ba172281e8c42d61)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:24.895971 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:24.953394 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35df3ff9283a4b76ba172281e8c42d61', 'request_id': 'req-b471008b-41ab-4b4c-b3ca-46635d0af75f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:24.960219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35df3ff9283a4b76ba172281e8c42d61', 'request_id': 'req-b471008b-41ab-4b4c-b3ca-46635d0af75f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:24.966884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35df3ff9283a4b76ba172281e8c42d61', 'request_id': 'req-b471008b-41ab-4b4c-b3ca-46635d0af75f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:24.980859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] The token cache is being invalidate because project 35df3ff9283a4b76ba172281e8c42d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:24.981149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:24.981765 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:24.983273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1147/2262] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:24 2022] DELETE /identity/v3/projects/35df3ff9283a4b76ba172281e8c42d61 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:24.987380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc863b-456b-4e83-a022-bc371831b5e3 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:24.997875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc863b-456b-4e83-a022-bc371831b5e3 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:25.058835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:25.059402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:25.059679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:25.059946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] PATH_INFO: `/v3/users/a377716d3a5d415ab1822727f010d3e7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:25.061234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a377716d3a5d415ab1822727f010d3e7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:25.063199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:25.115632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a377716d3a5d415ab1822727f010d3e7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:25.116317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a377716d3a5d415ab1822727f010d3e7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:25.123595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a377716d3a5d415ab1822727f010d3e7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:25.136153 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a377716d3a5d415ab1822727f010d3e7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:25.136829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ef14cb06-b333-4288-b6b2-8c358c466450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a377716d3a5d415ab1822727f010d3e7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:25.151321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1116/2263] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:24 2022] DELETE /identity/v3/users/a377716d3a5d415ab1822727f010d3e7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:25.435313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:25.436886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:25.445256 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:25.453826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471008b-41ab-4b4c-b3ca-46635d0af75f admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:25.515958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:25.516712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:25.516996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:25.517271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] PATH_INFO: `/v3/projects/ece5cad0af3b45619db39cda229ab19b` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:25.518413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece5cad0af3b45619db39cda229ab19b)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:25.520355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:25.574031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece5cad0af3b45619db39cda229ab19b', 'request_id': 'req-84f80753-6720-447a-a252-038e00e7d26d'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:25.583747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece5cad0af3b45619db39cda229ab19b', 'request_id': 'req-84f80753-6720-447a-a252-038e00e7d26d'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:25.591139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece5cad0af3b45619db39cda229ab19b', 'request_id': 'req-84f80753-6720-447a-a252-038e00e7d26d'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:25.604670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] The token cache is being invalidate because project ece5cad0af3b45619db39cda229ab19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:25.604960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:25.605660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-84f80753-6720-447a-a252-038e00e7d26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:25.607194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1148/2264] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:25 2022] DELETE /identity/v3/projects/ece5cad0af3b45619db39cda229ab19b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:25.612119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d411de-f963-470a-94ce-ea14f2faa035 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:25.612656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d411de-f963-470a-94ce-ea14f2faa035 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:25.612765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d411de-f963-470a-94ce-ea14f2faa035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:25.632690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-b4d411de-f963-470a-94ce-ea14f2faa035 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:25.633899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b4d411de-f963-470a-94ce-ea14f2faa035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:25.666096 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:25.703103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1117/2265] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:25.712376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516796-66d1-46ee-a20c-7fc0a08faa72 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:25.712693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516796-66d1-46ee-a20c-7fc0a08faa72 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:25.712989 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516796-66d1-46ee-a20c-7fc0a08faa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:25.733910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-37516796-66d1-46ee-a20c-7fc0a08faa72 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:25.735119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-37516796-66d1-46ee-a20c-7fc0a08faa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:25.744188 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1149/2266] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:25.748444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d411de-f963-470a-94ce-ea14f2faa035 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:25.758813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d411de-f963-470a-94ce-ea14f2faa035 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:25.764293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe3b6-21a2-47b1-b79c-67d642c7d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:25.764931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe3b6-21a2-47b1-b79c-67d642c7d7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:25.765204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe3b6-21a2-47b1-b79c-67d642c7d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:25.765470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe3b6-21a2-47b1-b79c-67d642c7d7bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:25.766145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fe3b6-21a2-47b1-b79c-67d642c7d7bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:30:25.766445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fe3b6-21a2-47b1-b79c-67d642c7d7bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:25.768051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fe3b6-21a2-47b1-b79c-67d642c7d7bc admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:25.780559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1118/2267] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:30:25.784976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516796-66d1-46ee-a20c-7fc0a08faa72 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:25.794743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516796-66d1-46ee-a20c-7fc0a08faa72 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:25.800422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06c380-160d-4493-99a9-a96d17dcfbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:25.801074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c380-160d-4493-99a9-a96d17dcfbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:25.801267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c380-160d-4493-99a9-a96d17dcfbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:25.801555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c380-160d-4493-99a9-a96d17dcfbe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:25.802200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06c380-160d-4493-99a9-a96d17dcfbe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:25.804114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06c380-160d-4493-99a9-a96d17dcfbe9 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:25.832303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1150/2268] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:25 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:25.836611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe3b6-21a2-47b1-b79c-67d642c7d7bc admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:25.846949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe3b6-21a2-47b1-b79c-67d642c7d7bc admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:25.906650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce6aca-40f5-460a-9613-a7707c3c999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:25.907266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce6aca-40f5-460a-9613-a7707c3c999f admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:25.907546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce6aca-40f5-460a-9613-a7707c3c999f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:25.907820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce6aca-40f5-460a-9613-a7707c3c999f admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:25.908508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce6aca-40f5-460a-9613-a7707c3c999f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:25.910450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce6aca-40f5-460a-9613-a7707c3c999f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:25.934159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1119/2269] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:25 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:30:25.938242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06c380-160d-4493-99a9-a96d17dcfbe9 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:25.951460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06c380-160d-4493-99a9-a96d17dcfbe9 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:25.956741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf276fb9-90c0-43a6-a69e-f84669ef77d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:25.957362 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf276fb9-90c0-43a6-a69e-f84669ef77d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:25.957645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf276fb9-90c0-43a6-a69e-f84669ef77d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:25.957921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf276fb9-90c0-43a6-a69e-f84669ef77d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:25.958581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf276fb9-90c0-43a6-a69e-f84669ef77d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:25.960243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf276fb9-90c0-43a6-a69e-f84669ef77d6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:25.971385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1151/2270] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:25.975415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce6aca-40f5-460a-9613-a7707c3c999f admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:25.987269 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce6aca-40f5-460a-9613-a7707c3c999f admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:25.992963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7852ba8-a374-41b2-8204-58045e0be7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:25.993608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852ba8-a374-41b2-8204-58045e0be7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:25.993890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852ba8-a374-41b2-8204-58045e0be7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:25.994167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852ba8-a374-41b2-8204-58045e0be7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:25.994824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7852ba8-a374-41b2-8204-58045e0be7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:25.996467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7852ba8-a374-41b2-8204-58045e0be7c1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:26.009756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1120/2271] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:26.013903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf276fb9-90c0-43a6-a69e-f84669ef77d6 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:26.025139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf276fb9-90c0-43a6-a69e-f84669ef77d6 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:26.031034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96ee92-1dfe-4cef-b18d-f208cc9e6a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:26.031743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96ee92-1dfe-4cef-b18d-f208cc9e6a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:26.032033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96ee92-1dfe-4cef-b18d-f208cc9e6a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:26.032405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96ee92-1dfe-4cef-b18d-f208cc9e6a0e admin admin] PATH_INFO: `/v3/projects/0b580242047848398dd10d9119f27d5f/users/f56c250ec1154ff3be9eedfb3df5e3c1/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:26.049781 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96ee92-1dfe-4cef-b18d-f208cc9e6a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b580242047848398dd10d9119f27d5f, user_id=f56c250ec1154ff3be9eedfb3df5e3c1, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:26.052758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96ee92-1dfe-4cef-b18d-f208cc9e6a0e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:26.088281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1152/2272] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:26 2022] PUT /identity/v3/projects/0b580242047848398dd10d9119f27d5f/users/f56c250ec1154ff3be9eedfb3df5e3c1/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:26.098900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a92a42-b1a6-4b7d-90f9-b506b888e3fb None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:26.099207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a92a42-b1a6-4b7d-90f9-b506b888e3fb None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:26.099450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a92a42-b1a6-4b7d-90f9-b506b888e3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:26.141400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-68a92a42-b1a6-4b7d-90f9-b506b888e3fb None None] MFA Rules not processed for user `f56c250ec1154ff3be9eedfb3df5e3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:26.142632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-68a92a42-b1a6-4b7d-90f9-b506b888e3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:26.226714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1121/2273] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:26.231537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96ee92-1dfe-4cef-b18d-f208cc9e6a0e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:26.263420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:26.296881 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96ee92-1dfe-4cef-b18d-f208cc9e6a0e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:26.301796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da81f50-95c5-4efb-8b90-b47e6eef1a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:26.302406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da81f50-95c5-4efb-8b90-b47e6eef1a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:26.302726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da81f50-95c5-4efb-8b90-b47e6eef1a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:26.302992 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da81f50-95c5-4efb-8b90-b47e6eef1a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:26.303637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da81f50-95c5-4efb-8b90-b47e6eef1a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:26.305646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da81f50-95c5-4efb-8b90-b47e6eef1a0a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:26.336444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1153/2274] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:26 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:26.340779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a92a42-b1a6-4b7d-90f9-b506b888e3fb None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:26.352717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a92a42-b1a6-4b7d-90f9-b506b888e3fb None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:26.379908 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:26.415960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef422ed-4096-4d42-bf91-fffdd3f26781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:26.416622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef422ed-4096-4d42-bf91-fffdd3f26781 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:26.416906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef422ed-4096-4d42-bf91-fffdd3f26781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:26.417166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef422ed-4096-4d42-bf91-fffdd3f26781 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:26.417814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef422ed-4096-4d42-bf91-fffdd3f26781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:26.419842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef422ed-4096-4d42-bf91-fffdd3f26781 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:26.443808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1122/2275] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:26 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:26.447885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da81f50-95c5-4efb-8b90-b47e6eef1a0a admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:26.458334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da81f50-95c5-4efb-8b90-b47e6eef1a0a admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:26.463219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4d8c2-8e3c-4a2a-90ab-538136acd922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:26.463816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4d8c2-8e3c-4a2a-90ab-538136acd922 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:26.464090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4d8c2-8e3c-4a2a-90ab-538136acd922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:26.464357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4d8c2-8e3c-4a2a-90ab-538136acd922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:26.465033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4d8c2-8e3c-4a2a-90ab-538136acd922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:26.466653 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4d8c2-8e3c-4a2a-90ab-538136acd922 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:26.476533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1154/2276] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:26.480784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef422ed-4096-4d42-bf91-fffdd3f26781 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:26.491270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef422ed-4096-4d42-bf91-fffdd3f26781 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:26.496488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b229c-cb82-40f7-b307-d58124d029a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:26.497138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b229c-cb82-40f7-b307-d58124d029a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:26.497416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b229c-cb82-40f7-b307-d58124d029a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:26.497663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b229c-cb82-40f7-b307-d58124d029a4 admin admin] PATH_INFO: `/v3/projects/688e2f607c7d4b45885e1c4efb2c8da0/users/1331c33ce5e34ec7bd661bef2a35f8d3/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:26.513665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b229c-cb82-40f7-b307-d58124d029a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e2f607c7d4b45885e1c4efb2c8da0, user_id=1331c33ce5e34ec7bd661bef2a35f8d3, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:26.516349 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b229c-cb82-40f7-b307-d58124d029a4 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:26.531734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1123/2277] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:26 2022] PUT /identity/v3/projects/688e2f607c7d4b45885e1c4efb2c8da0/users/1331c33ce5e34ec7bd661bef2a35f8d3/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:26.535225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4d8c2-8e3c-4a2a-90ab-538136acd922 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:26.545872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4d8c2-8e3c-4a2a-90ab-538136acd922 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:26.613406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78b51c-0686-43db-8a84-652a104f9d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:26.614928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b51c-0686-43db-8a84-652a104f9d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:26.614928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b51c-0686-43db-8a84-652a104f9d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:26.614928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b51c-0686-43db-8a84-652a104f9d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:26.615239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b51c-0686-43db-8a84-652a104f9d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:26.616874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b51c-0686-43db-8a84-652a104f9d23 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:26.627732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1155/2278] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:26.632225 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b229c-cb82-40f7-b307-d58124d029a4 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:26.644646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b229c-cb82-40f7-b307-d58124d029a4 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:26.651555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5b41-41ce-421e-a7e6-717377d0090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:26.652415 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5b41-41ce-421e-a7e6-717377d0090c admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:26.652782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5b41-41ce-421e-a7e6-717377d0090c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:26.653087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5b41-41ce-421e-a7e6-717377d0090c admin admin] PATH_INFO: `/v3/projects/688e2f607c7d4b45885e1c4efb2c8da0/users/1331c33ce5e34ec7bd661bef2a35f8d3/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:26.655287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf5b41-41ce-421e-a7e6-717377d0090c admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e2f607c7d4b45885e1c4efb2c8da0, user_id=1331c33ce5e34ec7bd661bef2a35f8d3, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:26.658035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf5b41-41ce-421e-a7e6-717377d0090c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:26.670163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1124/2279] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:26 2022] PUT /identity/v3/projects/688e2f607c7d4b45885e1c4efb2c8da0/users/1331c33ce5e34ec7bd661bef2a35f8d3/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:26.681388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19974aba-8227-4645-bc70-3bcce988df60 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:26.681746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19974aba-8227-4645-bc70-3bcce988df60 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:26.682090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19974aba-8227-4645-bc70-3bcce988df60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:26.712267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-19974aba-8227-4645-bc70-3bcce988df60 None None] MFA Rules not processed for user `1331c33ce5e34ec7bd661bef2a35f8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:26.713548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-19974aba-8227-4645-bc70-3bcce988df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:26.801958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1156/2280] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:26.814550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5b41-41ce-421e-a7e6-717377d0090c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:26.816590 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-21cf5b41-41ce-421e-a7e6-717377d0090c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:26.878809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5b41-41ce-421e-a7e6-717377d0090c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:26.882611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108e073-53b3-4185-9994-72681865e577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:26.883308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108e073-53b3-4185-9994-72681865e577 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:26.883637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108e073-53b3-4185-9994-72681865e577 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:26.883855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108e073-53b3-4185-9994-72681865e577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:26.893324 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108e073-53b3-4185-9994-72681865e577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:26.894768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108e073-53b3-4185-9994-72681865e577 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:26.904425 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1125/2281] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:26.933831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19974aba-8227-4645-bc70-3bcce988df60 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:26.962649 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:26.999886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19974aba-8227-4645-bc70-3bcce988df60 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:27.005795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:27.006434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:27.006707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:27.006980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] PATH_INFO: `/v3/users/f56c250ec1154ff3be9eedfb3df5e3c1` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:27.008198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56c250ec1154ff3be9eedfb3df5e3c1)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:27.010266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:27.060830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56c250ec1154ff3be9eedfb3df5e3c1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.061490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56c250ec1154ff3be9eedfb3df5e3c1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.062107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56c250ec1154ff3be9eedfb3df5e3c1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.069080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56c250ec1154ff3be9eedfb3df5e3c1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.080876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56c250ec1154ff3be9eedfb3df5e3c1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.096095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1157/2282] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:26 2022] DELETE /identity/v3/users/f56c250ec1154ff3be9eedfb3df5e3c1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:27.100833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae90902-aca0-4793-9343-338fa5569b45 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:27.101117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae90902-aca0-4793-9343-338fa5569b45 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:27.101389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae90902-aca0-4793-9343-338fa5569b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:27.121809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-aae90902-aca0-4793-9343-338fa5569b45 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:27.123013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-aae90902-aca0-4793-9343-338fa5569b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:27.194668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1126/2283] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:30:27.204745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:27.206354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:27.268955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eebc90-a574-454f-93cd-e6cb6b2fdab2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:27.272709 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db1e37-6837-4fe3-9525-90bf92d76748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:27.273318 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db1e37-6837-4fe3-9525-90bf92d76748 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:27.273642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db1e37-6837-4fe3-9525-90bf92d76748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:27.273963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db1e37-6837-4fe3-9525-90bf92d76748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:27.283548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db1e37-6837-4fe3-9525-90bf92d76748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:27.285223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db1e37-6837-4fe3-9525-90bf92d76748 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:27.294852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1158/2284] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:27.576177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae90902-aca0-4793-9343-338fa5569b45 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:27.577852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-aae90902-aca0-4793-9343-338fa5569b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:27.592140 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae90902-aca0-4793-9343-338fa5569b45 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:27.600597 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:27.603059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:27.603416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:27.603603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] PATH_INFO: `/v3/projects/0b580242047848398dd10d9119f27d5f` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:27.604907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b580242047848398dd10d9119f27d5f)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:27.606853 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:27.630435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:27.665249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b580242047848398dd10d9119f27d5f', 'request_id': 'req-0b9f9726-0ad6-4f24-be2d-c304461368b0'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.672286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b580242047848398dd10d9119f27d5f', 'request_id': 'req-0b9f9726-0ad6-4f24-be2d-c304461368b0'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.682893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b580242047848398dd10d9119f27d5f', 'request_id': 'req-0b9f9726-0ad6-4f24-be2d-c304461368b0'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.694809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] The token cache is being invalidate because project 0b580242047848398dd10d9119f27d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:27.695198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.695975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.697639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1127/2285] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:27 2022] DELETE /identity/v3/projects/0b580242047848398dd10d9119f27d5f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:27.701949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db1e37-6837-4fe3-9525-90bf92d76748 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:27.714163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db1e37-6837-4fe3-9525-90bf92d76748 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:27.761586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:27.776342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:27.777011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:27.777287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:27.777558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] PATH_INFO: `/v3/users/1331c33ce5e34ec7bd661bef2a35f8d3` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:27.778697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1331c33ce5e34ec7bd661bef2a35f8d3)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:27.780710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:27.831376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1331c33ce5e34ec7bd661bef2a35f8d3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.832029 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1331c33ce5e34ec7bd661bef2a35f8d3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.832680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1331c33ce5e34ec7bd661bef2a35f8d3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.839679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1331c33ce5e34ec7bd661bef2a35f8d3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.854460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1dab8a5c-ab74-481e-a052-f483d23e2ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1331c33ce5e34ec7bd661bef2a35f8d3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:27.871298 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1159/2286] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:27 2022] DELETE /identity/v3/users/1331c33ce5e34ec7bd661bef2a35f8d3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:28.157823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:28.159286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:28.184203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f9726-0ad6-4f24-be2d-c304461368b0 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:28.264521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:28.265182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:28.265465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:28.265737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] PATH_INFO: `/v3/projects/688e2f607c7d4b45885e1c4efb2c8da0` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:28.266909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688e2f607c7d4b45885e1c4efb2c8da0)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:28.268928 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:28.317546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688e2f607c7d4b45885e1c4efb2c8da0', 'request_id': 'req-71e0fce0-fd6c-406a-9dfc-bda82c349427'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:28.324282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688e2f607c7d4b45885e1c4efb2c8da0', 'request_id': 'req-71e0fce0-fd6c-406a-9dfc-bda82c349427'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:28.334696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688e2f607c7d4b45885e1c4efb2c8da0', 'request_id': 'req-71e0fce0-fd6c-406a-9dfc-bda82c349427'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:28.346030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] The token cache is being invalidate because project 688e2f607c7d4b45885e1c4efb2c8da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:28.346317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:28.346949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71e0fce0-fd6c-406a-9dfc-bda82c349427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:28.348468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1128/2287] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:28 2022] DELETE /identity/v3/projects/688e2f607c7d4b45885e1c4efb2c8da0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:28.353690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c4b88-7f01-44f1-9059-07c9954b293c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:28.353958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c4b88-7f01-44f1-9059-07c9954b293c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:28.354254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c4b88-7f01-44f1-9059-07c9954b293c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:28.377320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-a75c4b88-7f01-44f1-9059-07c9954b293c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:28.378545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a75c4b88-7f01-44f1-9059-07c9954b293c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:28.443423 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1160/2288] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:30:28.451334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2152b11-da8d-4c81-bc81-a52cc695bf6a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:28.451617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2152b11-da8d-4c81-bc81-a52cc695bf6a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:28.451890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2152b11-da8d-4c81-bc81-a52cc695bf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:28.472580 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-a2152b11-da8d-4c81-bc81-a52cc695bf6a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:28.473875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a2152b11-da8d-4c81-bc81-a52cc695bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:28.483517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1129/2289] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:28.487468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c4b88-7f01-44f1-9059-07c9954b293c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:28.498915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c4b88-7f01-44f1-9059-07c9954b293c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:28.504295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864308c-9309-42d4-9357-bf455d40e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:28.504997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864308c-9309-42d4-9357-bf455d40e525 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:28.505259 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864308c-9309-42d4-9357-bf455d40e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:28.505524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864308c-9309-42d4-9357-bf455d40e525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:28.506171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864308c-9309-42d4-9357-bf455d40e525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:30:28.506469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864308c-9309-42d4-9357-bf455d40e525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:28.508276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864308c-9309-42d4-9357-bf455d40e525 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:28.522234 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1161/2290] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:30:28.526442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2152b11-da8d-4c81-bc81-a52cc695bf6a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:28.536056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2152b11-da8d-4c81-bc81-a52cc695bf6a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:28.541609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280584fa-ed81-4353-ba6d-189725af55c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:28.542221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280584fa-ed81-4353-ba6d-189725af55c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:28.542509 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280584fa-ed81-4353-ba6d-189725af55c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:28.542776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280584fa-ed81-4353-ba6d-189725af55c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:28.543433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280584fa-ed81-4353-ba6d-189725af55c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:28.545400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280584fa-ed81-4353-ba6d-189725af55c1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:28.580317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1130/2291] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:28 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:28.581800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864308c-9309-42d4-9357-bf455d40e525 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:28.593125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864308c-9309-42d4-9357-bf455d40e525 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:28.641086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:28.652972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec29b6-e296-4afd-bf42-05cec58aaef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:28.653587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec29b6-e296-4afd-bf42-05cec58aaef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:28.653869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec29b6-e296-4afd-bf42-05cec58aaef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:28.654139 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec29b6-e296-4afd-bf42-05cec58aaef2 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:28.654776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec29b6-e296-4afd-bf42-05cec58aaef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:28.656792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec29b6-e296-4afd-bf42-05cec58aaef2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:28.683657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1162/2292] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:28 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:28.689305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280584fa-ed81-4353-ba6d-189725af55c1 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:28.701813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280584fa-ed81-4353-ba6d-189725af55c1 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:28.707335 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dfb90-ed5e-4aed-9f67-d79f4a4989b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:28.708469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dfb90-ed5e-4aed-9f67-d79f4a4989b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:28.708806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dfb90-ed5e-4aed-9f67-d79f4a4989b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:28.709072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dfb90-ed5e-4aed-9f67-d79f4a4989b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:28.709858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dfb90-ed5e-4aed-9f67-d79f4a4989b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:28.712002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dfb90-ed5e-4aed-9f67-d79f4a4989b0 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:28.714665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:28.724271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1131/2293] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:28.728320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec29b6-e296-4afd-bf42-05cec58aaef2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:28.738540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec29b6-e296-4afd-bf42-05cec58aaef2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:28.743624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1ea56-6d66-48d5-bd5a-878a7dae63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:28.744294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ea56-6d66-48d5-bd5a-878a7dae63a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:28.744603 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ea56-6d66-48d5-bd5a-878a7dae63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:28.744878 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ea56-6d66-48d5-bd5a-878a7dae63a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:28.745533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1ea56-6d66-48d5-bd5a-878a7dae63a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:28.747163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1ea56-6d66-48d5-bd5a-878a7dae63a1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:28.759150 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1163/2294] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:28.766818 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dfb90-ed5e-4aed-9f67-d79f4a4989b0 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:28.773938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dfb90-ed5e-4aed-9f67-d79f4a4989b0 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:28.780697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5c83-8d3e-4aa1-8982-bdaa30674d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:28.781510 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5c83-8d3e-4aa1-8982-bdaa30674d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:28.781875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5c83-8d3e-4aa1-8982-bdaa30674d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:28.782198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5c83-8d3e-4aa1-8982-bdaa30674d25 admin admin] PATH_INFO: `/v3/projects/1f9e21dbedea426089e0ddbd3aea2419/users/44f794c25e7d4773abcaf49a470234be/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:28.801809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f5c83-8d3e-4aa1-8982-bdaa30674d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9e21dbedea426089e0ddbd3aea2419, user_id=44f794c25e7d4773abcaf49a470234be, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:28.804781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f5c83-8d3e-4aa1-8982-bdaa30674d25 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:28.821331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1132/2295] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:28 2022] PUT /identity/v3/projects/1f9e21dbedea426089e0ddbd3aea2419/users/44f794c25e7d4773abcaf49a470234be/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:30:28.832058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9174a-5dc2-434d-baa1-fe183dd058a6 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:28.832343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9174a-5dc2-434d-baa1-fe183dd058a6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:28.832648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9174a-5dc2-434d-baa1-fe183dd058a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:28.862550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-16a9174a-5dc2-434d-baa1-fe183dd058a6 None None] MFA Rules not processed for user `44f794c25e7d4773abcaf49a470234be`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:28.863799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-16a9174a-5dc2-434d-baa1-fe183dd058a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:28.934267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1164/2296] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:28.938897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5c83-8d3e-4aa1-8982-bdaa30674d25 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:29.002857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5c83-8d3e-4aa1-8982-bdaa30674d25 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:29.007624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8d4aa-42c4-4d1c-be16-f46b38053ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:29.008354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8d4aa-42c4-4d1c-be16-f46b38053ede admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:29.008639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8d4aa-42c4-4d1c-be16-f46b38053ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:29.008907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8d4aa-42c4-4d1c-be16-f46b38053ede admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:29.009552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8d4aa-42c4-4d1c-be16-f46b38053ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:29.011486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8d4aa-42c4-4d1c-be16-f46b38053ede admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:29.041129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1133/2297] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:28 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:29.045287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9174a-5dc2-434d-baa1-fe183dd058a6 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:29.057417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9174a-5dc2-434d-baa1-fe183dd058a6 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:29.118014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c556d-eafe-4cd5-8207-aecfe4e624a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:29.118677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c556d-eafe-4cd5-8207-aecfe4e624a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:29.119006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c556d-eafe-4cd5-8207-aecfe4e624a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:29.119226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c556d-eafe-4cd5-8207-aecfe4e624a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:29.120004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c556d-eafe-4cd5-8207-aecfe4e624a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:29.122026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c556d-eafe-4cd5-8207-aecfe4e624a4 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:29.149503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1165/2298] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:29 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:30:29.153999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8d4aa-42c4-4d1c-be16-f46b38053ede admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:29.165311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8d4aa-42c4-4d1c-be16-f46b38053ede admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:29.170876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cdbf3-51d7-4f2e-b110-b0d8dbfea140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:29.171555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cdbf3-51d7-4f2e-b110-b0d8dbfea140 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:29.171903 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cdbf3-51d7-4f2e-b110-b0d8dbfea140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:29.172223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cdbf3-51d7-4f2e-b110-b0d8dbfea140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:29.172979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cdbf3-51d7-4f2e-b110-b0d8dbfea140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:29.174757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cdbf3-51d7-4f2e-b110-b0d8dbfea140 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:29.186691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1134/2299] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:29.190781 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c556d-eafe-4cd5-8207-aecfe4e624a4 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:29.201391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c556d-eafe-4cd5-8207-aecfe4e624a4 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:29.206848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1c1bd-2051-46db-8966-04114c84994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:29.207510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1c1bd-2051-46db-8966-04114c84994c admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:29.207789 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1c1bd-2051-46db-8966-04114c84994c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:29.208057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1c1bd-2051-46db-8966-04114c84994c admin admin] PATH_INFO: `/v3/projects/7bb85a2bc45c4dc19fa233625c302c20/users/7f7365d7c8b646ba87c7254a28d4fdd4/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:29.225468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1c1bd-2051-46db-8966-04114c84994c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb85a2bc45c4dc19fa233625c302c20, user_id=7f7365d7c8b646ba87c7254a28d4fdd4, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:29.228315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1c1bd-2051-46db-8966-04114c84994c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:29.244800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1166/2300] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:29 2022] PUT /identity/v3/projects/7bb85a2bc45c4dc19fa233625c302c20/users/7f7365d7c8b646ba87c7254a28d4fdd4/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:30:29.248919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cdbf3-51d7-4f2e-b110-b0d8dbfea140 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:29.260131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cdbf3-51d7-4f2e-b110-b0d8dbfea140 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:29.319230 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c6989-f62d-4f78-bf13-75e356198192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:29.319851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c6989-f62d-4f78-bf13-75e356198192 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:29.320150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c6989-f62d-4f78-bf13-75e356198192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:29.320777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c6989-f62d-4f78-bf13-75e356198192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:29.321312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c6989-f62d-4f78-bf13-75e356198192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:29.322962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c6989-f62d-4f78-bf13-75e356198192 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:29.334528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1135/2301] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:29.339058 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1c1bd-2051-46db-8966-04114c84994c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:29.350938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1c1bd-2051-46db-8966-04114c84994c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:29.357445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074c905-e964-431e-8eb1-ba27c96c4388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:29.358123 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074c905-e964-431e-8eb1-ba27c96c4388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:29.358399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074c905-e964-431e-8eb1-ba27c96c4388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:29.358671 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074c905-e964-431e-8eb1-ba27c96c4388 admin admin] PATH_INFO: `/v3/projects/7bb85a2bc45c4dc19fa233625c302c20/users/7f7365d7c8b646ba87c7254a28d4fdd4/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:29.360690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074c905-e964-431e-8eb1-ba27c96c4388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb85a2bc45c4dc19fa233625c302c20, user_id=7f7365d7c8b646ba87c7254a28d4fdd4, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:29.363397 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074c905-e964-431e-8eb1-ba27c96c4388 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:29.374361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1167/2302] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:29 2022] PUT /identity/v3/projects/7bb85a2bc45c4dc19fa233625c302c20/users/7f7365d7c8b646ba87c7254a28d4fdd4/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:29.387744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7406e23-4783-4a75-a7ed-e5d2b92c8f42 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:29.388053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7406e23-4783-4a75-a7ed-e5d2b92c8f42 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:29.388408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7406e23-4783-4a75-a7ed-e5d2b92c8f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:29.420114 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-d7406e23-4783-4a75-a7ed-e5d2b92c8f42 None None] MFA Rules not processed for user `7f7365d7c8b646ba87c7254a28d4fdd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:29.421687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d7406e23-4783-4a75-a7ed-e5d2b92c8f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:29.467888 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:29.512251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1136/2303] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:29.525447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074c905-e964-431e-8eb1-ba27c96c4388 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:29.527372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2074c905-e964-431e-8eb1-ba27c96c4388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:29.546336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:29.598357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074c905-e964-431e-8eb1-ba27c96c4388 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:29.602360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eb565-baf8-4327-b578-99ae748a1215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:29.602975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eb565-baf8-4327-b578-99ae748a1215 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:29.603253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eb565-baf8-4327-b578-99ae748a1215 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:29.603525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eb565-baf8-4327-b578-99ae748a1215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:29.613191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eb565-baf8-4327-b578-99ae748a1215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:29.615714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eb565-baf8-4327-b578-99ae748a1215 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:29.626183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1168/2304] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:29.691371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7406e23-4783-4a75-a7ed-e5d2b92c8f42 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:29.692428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d7406e23-4783-4a75-a7ed-e5d2b92c8f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:29.706396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7406e23-4783-4a75-a7ed-e5d2b92c8f42 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:29.711651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215d4b9-6eb6-4698-8ed6-d0b7638fb910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:29.712545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215d4b9-6eb6-4698-8ed6-d0b7638fb910 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:29.713067 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215d4b9-6eb6-4698-8ed6-d0b7638fb910 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:29.713392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215d4b9-6eb6-4698-8ed6-d0b7638fb910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:29.791406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215d4b9-6eb6-4698-8ed6-d0b7638fb910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:29.792900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215d4b9-6eb6-4698-8ed6-d0b7638fb910 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:29.806599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1137/2305] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:37.508492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eb565-baf8-4327-b578-99ae748a1215 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:37.573382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eb565-baf8-4327-b578-99ae748a1215 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:37.579809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:37.580867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:37.581148 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:37.581419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] PATH_INFO: `/v3/users/44f794c25e7d4773abcaf49a470234be` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:37.582584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f794c25e7d4773abcaf49a470234be)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:37.584608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:37.640967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f794c25e7d4773abcaf49a470234be'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:37.641627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f794c25e7d4773abcaf49a470234be'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:37.642234 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f794c25e7d4773abcaf49a470234be'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:37.649449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f794c25e7d4773abcaf49a470234be'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:37.661374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f794c25e7d4773abcaf49a470234be'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:37.675346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1169/2306] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:37 2022] DELETE /identity/v3/users/44f794c25e7d4773abcaf49a470234be => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:37.681453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94423052-28a0-4c58-b689-2ba5c89891bf None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:37.681987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94423052-28a0-4c58-b689-2ba5c89891bf None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:37.682199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94423052-28a0-4c58-b689-2ba5c89891bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:37.703282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-94423052-28a0-4c58-b689-2ba5c89891bf None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:37.704608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-94423052-28a0-4c58-b689-2ba5c89891bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:37.765200 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1138/2307] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:37.775297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:37.776845 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:37.816576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:37.835652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b9fb1-25d9-4790-8e12-347bcec31999 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:37.839789 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287958f4-751f-488c-8868-14322bf077a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:37.840440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287958f4-751f-488c-8868-14322bf077a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:37.840734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287958f4-751f-488c-8868-14322bf077a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:37.841021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287958f4-751f-488c-8868-14322bf077a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:37.851166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287958f4-751f-488c-8868-14322bf077a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:37.852698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287958f4-751f-488c-8868-14322bf077a3 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:37.862232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1170/2308] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:38.142477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94423052-28a0-4c58-b689-2ba5c89891bf None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:38.143956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-94423052-28a0-4c58-b689-2ba5c89891bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:38.156179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94423052-28a0-4c58-b689-2ba5c89891bf None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:38.160973 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:38.161611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:38.161878 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:38.162152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] PATH_INFO: `/v3/projects/1f9e21dbedea426089e0ddbd3aea2419` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:38.163341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9e21dbedea426089e0ddbd3aea2419)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:38.165490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:38.217595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9e21dbedea426089e0ddbd3aea2419', 'request_id': 'req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.225162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9e21dbedea426089e0ddbd3aea2419', 'request_id': 'req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.236822 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9e21dbedea426089e0ddbd3aea2419', 'request_id': 'req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.238979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:38.251529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] The token cache is being invalidate because project 1f9e21dbedea426089e0ddbd3aea2419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:38.251828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.252880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.254377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1139/2309] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:38 2022] DELETE /identity/v3/projects/1f9e21dbedea426089e0ddbd3aea2419 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:38.258701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287958f4-751f-488c-8868-14322bf077a3 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:38.268324 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287958f4-751f-488c-8868-14322bf077a3 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:38.332149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:38.332839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:38.333128 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:38.333405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] PATH_INFO: `/v3/users/7f7365d7c8b646ba87c7254a28d4fdd4` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:38.334541 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7365d7c8b646ba87c7254a28d4fdd4)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:38.336816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:38.387415 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7365d7c8b646ba87c7254a28d4fdd4'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.387985 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7365d7c8b646ba87c7254a28d4fdd4'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.388635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7365d7c8b646ba87c7254a28d4fdd4'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.395756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7365d7c8b646ba87c7254a28d4fdd4'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.409006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a41e685a-0bc5-4b99-9f1c-48604b129751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7365d7c8b646ba87c7254a28d4fdd4'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.424940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1171/2310] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:38 2022] DELETE /identity/v3/users/7f7365d7c8b646ba87c7254a28d4fdd4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:38.719151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:38.720969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:38.738172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ca5be-c6ed-4f19-9679-3dd0f342afe6 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:38.802786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:38.803427 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:38.803772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:38.804483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] PATH_INFO: `/v3/projects/7bb85a2bc45c4dc19fa233625c302c20` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:38.805400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb85a2bc45c4dc19fa233625c302c20)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:38.807321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:38.856456 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb85a2bc45c4dc19fa233625c302c20', 'request_id': 'req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.862743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb85a2bc45c4dc19fa233625c302c20', 'request_id': 'req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.872145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb85a2bc45c4dc19fa233625c302c20', 'request_id': 'req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.883651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] The token cache is being invalidate because project 7bb85a2bc45c4dc19fa233625c302c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:38.883940 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.884681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d712b903-7aa8-4b60-bbbd-3b3afeccbb99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:38.886341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1140/2311] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:38 2022] DELETE /identity/v3/projects/7bb85a2bc45c4dc19fa233625c302c20 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:38.891538 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec63e1-bfda-41c3-902a-c21c21349f93 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:38.892032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec63e1-bfda-41c3-902a-c21c21349f93 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:38.892032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec63e1-bfda-41c3-902a-c21c21349f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:38.914660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8eec63e1-bfda-41c3-902a-c21c21349f93 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:38.915915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8eec63e1-bfda-41c3-902a-c21c21349f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:38.971771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:38.990135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1172/2312] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:38.991630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df546f-b9f3-4d49-b8d9-b4b987fd4d9c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:38.991927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df546f-b9f3-4d49-b8d9-b4b987fd4d9c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:38.992185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df546f-b9f3-4d49-b8d9-b4b987fd4d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.014254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-85df546f-b9f3-4d49-b8d9-b4b987fd4d9c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:39.015460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-85df546f-b9f3-4d49-b8d9-b4b987fd4d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:39.024535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1141/2313] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:30:39.028864 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec63e1-bfda-41c3-902a-c21c21349f93 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.039347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec63e1-bfda-41c3-902a-c21c21349f93 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.044913 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6462e93-4a78-46b9-b14a-77261677337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.045531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6462e93-4a78-46b9-b14a-77261677337b admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.045821 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6462e93-4a78-46b9-b14a-77261677337b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.046075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6462e93-4a78-46b9-b14a-77261677337b admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.046734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6462e93-4a78-46b9-b14a-77261677337b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:30:39.047034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6462e93-4a78-46b9-b14a-77261677337b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.048754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6462e93-4a78-46b9-b14a-77261677337b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.061469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1173/2314] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:30:39.066017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df546f-b9f3-4d49-b8d9-b4b987fd4d9c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.076169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df546f-b9f3-4d49-b8d9-b4b987fd4d9c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.081743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcf2e-0981-4469-8ca0-7bbf4a60d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.082429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcf2e-0981-4469-8ca0-7bbf4a60d1fa admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.082711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcf2e-0981-4469-8ca0-7bbf4a60d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.082982 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcf2e-0981-4469-8ca0-7bbf4a60d1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.083640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bcf2e-0981-4469-8ca0-7bbf4a60d1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.085927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bcf2e-0981-4469-8ca0-7bbf4a60d1fa admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.117956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1142/2315] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:39 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:39.122506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6462e93-4a78-46b9-b14a-77261677337b admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.134145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6462e93-4a78-46b9-b14a-77261677337b admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.191580 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d99352-daef-497a-b21f-a84306000ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.192097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d99352-daef-497a-b21f-a84306000ced admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.192368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d99352-daef-497a-b21f-a84306000ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.192666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d99352-daef-497a-b21f-a84306000ced admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.193320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d99352-daef-497a-b21f-a84306000ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.195469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d99352-daef-497a-b21f-a84306000ced admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.218849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1174/2316] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:39 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:39.223109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcf2e-0981-4469-8ca0-7bbf4a60d1fa admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.233854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcf2e-0981-4469-8ca0-7bbf4a60d1fa admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.238983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850eb14-cbbc-4e8a-baef-42ef84982395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.239579 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850eb14-cbbc-4e8a-baef-42ef84982395 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.239858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850eb14-cbbc-4e8a-baef-42ef84982395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.240131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850eb14-cbbc-4e8a-baef-42ef84982395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.240837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850eb14-cbbc-4e8a-baef-42ef84982395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.243062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850eb14-cbbc-4e8a-baef-42ef84982395 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.254430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1143/2317] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:39.258443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d99352-daef-497a-b21f-a84306000ced admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.269001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d99352-daef-497a-b21f-a84306000ced admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.274726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72e1f7-b3b9-4b51-a9e1-6157c97a0768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.275327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72e1f7-b3b9-4b51-a9e1-6157c97a0768 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.275610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72e1f7-b3b9-4b51-a9e1-6157c97a0768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.275886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72e1f7-b3b9-4b51-a9e1-6157c97a0768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.276583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72e1f7-b3b9-4b51-a9e1-6157c97a0768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.278208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72e1f7-b3b9-4b51-a9e1-6157c97a0768 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.289099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1175/2318] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:39.293859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850eb14-cbbc-4e8a-baef-42ef84982395 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.307558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850eb14-cbbc-4e8a-baef-42ef84982395 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.313598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7654877-7423-4ed2-ab76-dbe4a97c46dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.314238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7654877-7423-4ed2-ab76-dbe4a97c46dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.314511 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7654877-7423-4ed2-ab76-dbe4a97c46dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.314900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7654877-7423-4ed2-ab76-dbe4a97c46dc admin admin] PATH_INFO: `/v3/projects/8371882ff4e34fc2953d09886348ad4c/users/9e0392e7a72f4f32af850169e2ffef67/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.335488 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7654877-7423-4ed2-ab76-dbe4a97c46dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8371882ff4e34fc2953d09886348ad4c, user_id=9e0392e7a72f4f32af850169e2ffef67, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.338218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7654877-7423-4ed2-ab76-dbe4a97c46dc admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.354182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1144/2319] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:39 2022] PUT /identity/v3/projects/8371882ff4e34fc2953d09886348ad4c/users/9e0392e7a72f4f32af850169e2ffef67/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:39.367890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d33d5-c150-4516-9746-5b595fb9470f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.368178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d33d5-c150-4516-9746-5b595fb9470f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.368475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d33d5-c150-4516-9746-5b595fb9470f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.390663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7654877-7423-4ed2-ab76-dbe4a97c46dc admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.392569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a7654877-7423-4ed2-ab76-dbe4a97c46dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:39.397757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1b8d33d5-c150-4516-9746-5b595fb9470f None None] MFA Rules not processed for user `9e0392e7a72f4f32af850169e2ffef67`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:39.399023 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1b8d33d5-c150-4516-9746-5b595fb9470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:39.414805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:39.465636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7654877-7423-4ed2-ab76-dbe4a97c46dc admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.470697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.471327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.471604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.471876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] PATH_INFO: `/v3/users/0173abc992a2402eb854a3bdfe0fd54d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.472705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1176/2320] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:39.473055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0173abc992a2402eb854a3bdfe0fd54d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.475019 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.477516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d33d5-c150-4516-9746-5b595fb9470f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.487773 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d33d5-c150-4516-9746-5b595fb9470f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.492694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f3b97-c5cd-49be-9937-4c3b2cfee854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.493306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f3b97-c5cd-49be-9937-4c3b2cfee854 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.493584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f3b97-c5cd-49be-9937-4c3b2cfee854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.493945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f3b97-c5cd-49be-9937-4c3b2cfee854 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.494536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f3b97-c5cd-49be-9937-4c3b2cfee854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.496585 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f3b97-c5cd-49be-9937-4c3b2cfee854 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.524875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0173abc992a2402eb854a3bdfe0fd54d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:39.525677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0173abc992a2402eb854a3bdfe0fd54d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:39.528414 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1177/2321] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:39 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:30:39.530772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f3b97-c5cd-49be-9937-4c3b2cfee854 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.532344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-735f3b97-c5cd-49be-9937-4c3b2cfee854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:39.533325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0173abc992a2402eb854a3bdfe0fd54d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:39.545020 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0173abc992a2402eb854a3bdfe0fd54d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:39.545730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-87f94362-2d5b-40c8-a00c-c935e937dd1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0173abc992a2402eb854a3bdfe0fd54d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:39.560941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1145/2322] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:39 2022] DELETE /identity/v3/users/0173abc992a2402eb854a3bdfe0fd54d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:30:39.565334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06d2be-1b03-4e57-a5b2-1709eea55578 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.565727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06d2be-1b03-4e57-a5b2-1709eea55578 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.566102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06d2be-1b03-4e57-a5b2-1709eea55578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.567461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:39.586513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ea06d2be-1b03-4e57-a5b2-1709eea55578 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:39.587732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ea06d2be-1b03-4e57-a5b2-1709eea55578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:39.599434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f3b97-c5cd-49be-9937-4c3b2cfee854 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.652099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1146/2323] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:30:39.660565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50deec2e-4b97-4f09-8645-ee7f637aa7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.661369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50deec2e-4b97-4f09-8645-ee7f637aa7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.661648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50deec2e-4b97-4f09-8645-ee7f637aa7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.661809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06d2be-1b03-4e57-a5b2-1709eea55578 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.661909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50deec2e-4b97-4f09-8645-ee7f637aa7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.662693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50deec2e-4b97-4f09-8645-ee7f637aa7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.663366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ea06d2be-1b03-4e57-a5b2-1709eea55578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:39.664787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50deec2e-4b97-4f09-8645-ee7f637aa7a8 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.692867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1178/2324] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:39 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:30:39.694000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50deec2e-4b97-4f09-8645-ee7f637aa7a8 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.705223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50deec2e-4b97-4f09-8645-ee7f637aa7a8 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.709553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:39.710246 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecbde7-4dbd-431f-9a22-aa315ed787ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.711119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecbde7-4dbd-431f-9a22-aa315ed787ce admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.711395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecbde7-4dbd-431f-9a22-aa315ed787ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.711668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecbde7-4dbd-431f-9a22-aa315ed787ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.712372 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecbde7-4dbd-431f-9a22-aa315ed787ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.714132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecbde7-4dbd-431f-9a22-aa315ed787ce admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.727992 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1179/2325] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:39.729325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecbde7-4dbd-431f-9a22-aa315ed787ce admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.729880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06d2be-1b03-4e57-a5b2-1709eea55578 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.733553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa5a44-2ce1-425e-b2d2-779c770acd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.734156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5a44-2ce1-425e-b2d2-779c770acd08 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.734433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5a44-2ce1-425e-b2d2-779c770acd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.734756 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5a44-2ce1-425e-b2d2-779c770acd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.739049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecbde7-4dbd-431f-9a22-aa315ed787ce admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.743979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1640f2-eada-4d26-833d-38661845bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.744161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa5a44-2ce1-425e-b2d2-779c770acd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.744647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1640f2-eada-4d26-833d-38661845bdac admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.744929 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1640f2-eada-4d26-833d-38661845bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.745205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1640f2-eada-4d26-833d-38661845bdac admin admin] PATH_INFO: `/v3/projects/504c0f6ba18a430eb326c5ca9b68258b/users/b9bf018ea11f49d29bbd76d802807407/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.745656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa5a44-2ce1-425e-b2d2-779c770acd08 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.760366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1640f2-eada-4d26-833d-38661845bdac admin admin] RBAC: Authorizing `identity:create_grant(project_id=504c0f6ba18a430eb326c5ca9b68258b, user_id=b9bf018ea11f49d29bbd76d802807407, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.761449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1147/2326] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:30:39.763132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1640f2-eada-4d26-833d-38661845bdac admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.778593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1180/2327] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:39 2022] PUT /identity/v3/projects/504c0f6ba18a430eb326c5ca9b68258b/users/b9bf018ea11f49d29bbd76d802807407/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:39.782681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa5a44-2ce1-425e-b2d2-779c770acd08 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.792260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa5a44-2ce1-425e-b2d2-779c770acd08 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.857659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d03123-f7fa-4690-a785-11265b2081ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.858267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d03123-f7fa-4690-a785-11265b2081ed admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.858540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d03123-f7fa-4690-a785-11265b2081ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.858805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d03123-f7fa-4690-a785-11265b2081ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.859449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d03123-f7fa-4690-a785-11265b2081ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.861078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d03123-f7fa-4690-a785-11265b2081ed admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.872812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1148/2328] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:39.877413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1640f2-eada-4d26-833d-38661845bdac admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:39.888437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1640f2-eada-4d26-833d-38661845bdac admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:39.894130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad373-3b1e-47c8-be01-d404eb5662f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:39.894792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad373-3b1e-47c8-be01-d404eb5662f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.895098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad373-3b1e-47c8-be01-d404eb5662f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.895374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad373-3b1e-47c8-be01-d404eb5662f7 admin admin] PATH_INFO: `/v3/projects/504c0f6ba18a430eb326c5ca9b68258b/users/b9bf018ea11f49d29bbd76d802807407/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.897978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fad373-3b1e-47c8-be01-d404eb5662f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504c0f6ba18a430eb326c5ca9b68258b, user_id=b9bf018ea11f49d29bbd76d802807407, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:39.900887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fad373-3b1e-47c8-be01-d404eb5662f7 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:39.927471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1181/2329] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:39 2022] PUT /identity/v3/projects/504c0f6ba18a430eb326c5ca9b68258b/users/b9bf018ea11f49d29bbd76d802807407/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:39.939219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe386-a290-4e16-8822-09bbef4b915b None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:39.939506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe386-a290-4e16-8822-09bbef4b915b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:39.939787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe386-a290-4e16-8822-09bbef4b915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:39.968277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-24bbe386-a290-4e16-8822-09bbef4b915b None None] MFA Rules not processed for user `b9bf018ea11f49d29bbd76d802807407`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:39.969360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-24bbe386-a290-4e16-8822-09bbef4b915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:40.044015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1149/2330] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:30:40.047200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad373-3b1e-47c8-be01-d404eb5662f7 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:40.049125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d8fad373-3b1e-47c8-be01-d404eb5662f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:40.057422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbe386-a290-4e16-8822-09bbef4b915b None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:40.058993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-24bbe386-a290-4e16-8822-09bbef4b915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:40.120241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbe386-a290-4e16-8822-09bbef4b915b None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:40.121001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad373-3b1e-47c8-be01-d404eb5662f7 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:40.123961 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b2675-d6ce-453d-a118-d39d3e01daae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:40.124613 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b2675-d6ce-453d-a118-d39d3e01daae service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.124895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b2675-d6ce-453d-a118-d39d3e01daae service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.125222 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b2675-d6ce-453d-a118-d39d3e01daae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.126164 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:40.126891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.127169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.127438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] PATH_INFO: `/v3/projects/fc60d4648fbf48e0b690c8f08cd287e5` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.128594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc60d4648fbf48e0b690c8f08cd287e5)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:40.130525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:40.135098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b2675-d6ce-453d-a118-d39d3e01daae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:40.136603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b2675-d6ce-453d-a118-d39d3e01daae service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:40.146861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1150/2331] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:30:40.153708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:40.180771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc60d4648fbf48e0b690c8f08cd287e5', 'request_id': 'req-a0daae2d-112d-48f2-9b18-be413099fbb1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:40.187491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc60d4648fbf48e0b690c8f08cd287e5', 'request_id': 'req-a0daae2d-112d-48f2-9b18-be413099fbb1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:40.193304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc60d4648fbf48e0b690c8f08cd287e5', 'request_id': 'req-a0daae2d-112d-48f2-9b18-be413099fbb1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:40.210015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] The token cache is being invalidate because project fc60d4648fbf48e0b690c8f08cd287e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:40.210790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:40.211665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:40.213375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1182/2332] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:40 2022] DELETE /identity/v3/projects/fc60d4648fbf48e0b690c8f08cd287e5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:40.218674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65448-51f8-4a5c-b533-19f9b0fad20b None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.219102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65448-51f8-4a5c-b533-19f9b0fad20b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.219407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65448-51f8-4a5c-b533-19f9b0fad20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.228520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:40.240414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-aaf65448-51f8-4a5c-b533-19f9b0fad20b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:40.241959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-aaf65448-51f8-4a5c-b533-19f9b0fad20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:40.256231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:40.258176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:40.308120 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1151/2333] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:40.315954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9290ba-0cd8-4cf7-b904-37d47f7951c4 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.316241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9290ba-0cd8-4cf7-b904-37d47f7951c4 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.316554 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9290ba-0cd8-4cf7-b904-37d47f7951c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.318984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daae2d-112d-48f2-9b18-be413099fbb1 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:40.323070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff29167-90dd-43dd-8598-ef44503b75f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:40.323739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff29167-90dd-43dd-8598-ef44503b75f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.324014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff29167-90dd-43dd-8598-ef44503b75f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.324424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff29167-90dd-43dd-8598-ef44503b75f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.326388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2ff29167-90dd-43dd-8598-ef44503b75f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:40.336405 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-9d9290ba-0cd8-4cf7-b904-37d47f7951c4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:40.337579 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9d9290ba-0cd8-4cf7-b904-37d47f7951c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:40.345719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1152/2334] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:30:40.349848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9290ba-0cd8-4cf7-b904-37d47f7951c4 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:40.358925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9290ba-0cd8-4cf7-b904-37d47f7951c4 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:40.363655 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055557a-68f5-4b0a-ae0a-f01aeea8fbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:40.364246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055557a-68f5-4b0a-ae0a-f01aeea8fbcb admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.364567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055557a-68f5-4b0a-ae0a-f01aeea8fbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.364857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055557a-68f5-4b0a-ae0a-f01aeea8fbcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.365501 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055557a-68f5-4b0a-ae0a-f01aeea8fbcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:30:40.365805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055557a-68f5-4b0a-ae0a-f01aeea8fbcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:40.367759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055557a-68f5-4b0a-ae0a-f01aeea8fbcb admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:40.379883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1153/2335] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:30:40.384495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055557a-68f5-4b0a-ae0a-f01aeea8fbcb admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:40.387948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff29167-90dd-43dd-8598-ef44503b75f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:40.389450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff29167-90dd-43dd-8598-ef44503b75f1 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:40.394638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055557a-68f5-4b0a-ae0a-f01aeea8fbcb admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:40.399201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1183/2336] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:40.400210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec308df3-48de-48ba-8565-bb65e4a198bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:40.400915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec308df3-48de-48ba-8565-bb65e4a198bf admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.401194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec308df3-48de-48ba-8565-bb65e4a198bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.402251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec308df3-48de-48ba-8565-bb65e4a198bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.402877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec308df3-48de-48ba-8565-bb65e4a198bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:40.404838 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec308df3-48de-48ba-8565-bb65e4a198bf admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:40.435072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1154/2337] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:40 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:40.439152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff29167-90dd-43dd-8598-ef44503b75f1 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:40.450407 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff29167-90dd-43dd-8598-ef44503b75f1 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:40.511753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908da25e-584d-4e9d-8c6a-2fd1813df8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:40.512370 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908da25e-584d-4e9d-8c6a-2fd1813df8db admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.512680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908da25e-584d-4e9d-8c6a-2fd1813df8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.512951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908da25e-584d-4e9d-8c6a-2fd1813df8db admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.513574 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908da25e-584d-4e9d-8c6a-2fd1813df8db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:40.515531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908da25e-584d-4e9d-8c6a-2fd1813df8db admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:40.526819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:40.541921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1184/2338] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:40 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:40.546118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec308df3-48de-48ba-8565-bb65e4a198bf admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:40.558727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec308df3-48de-48ba-8565-bb65e4a198bf admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:40.564297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498110a6-0624-4b5f-a2f7-e3915f2f0567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:40.565024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498110a6-0624-4b5f-a2f7-e3915f2f0567 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.565313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498110a6-0624-4b5f-a2f7-e3915f2f0567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.565584 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498110a6-0624-4b5f-a2f7-e3915f2f0567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.566231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498110a6-0624-4b5f-a2f7-e3915f2f0567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:40.567843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498110a6-0624-4b5f-a2f7-e3915f2f0567 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:40.579695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1155/2339] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:40.583834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908da25e-584d-4e9d-8c6a-2fd1813df8db admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:40.594824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908da25e-584d-4e9d-8c6a-2fd1813df8db admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:40.601836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2129c7-5c84-4dba-8dd6-cd687810613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:40.602484 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2129c7-5c84-4dba-8dd6-cd687810613f admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.602806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2129c7-5c84-4dba-8dd6-cd687810613f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.603128 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2129c7-5c84-4dba-8dd6-cd687810613f admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.603865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2129c7-5c84-4dba-8dd6-cd687810613f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:40.606045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2129c7-5c84-4dba-8dd6-cd687810613f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:40.620629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1185/2340] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:40.624897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498110a6-0624-4b5f-a2f7-e3915f2f0567 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:40.636163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498110a6-0624-4b5f-a2f7-e3915f2f0567 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:40.641666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab32bb-61b1-4fe2-b209-52caef44a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:40.642338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab32bb-61b1-4fe2-b209-52caef44a598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.642631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab32bb-61b1-4fe2-b209-52caef44a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.642900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab32bb-61b1-4fe2-b209-52caef44a598 admin admin] PATH_INFO: `/v3/projects/994ded4dc2704bc2870229c8f2e18998/users/a913b9b672bb49c5bf553e9552627669/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.667833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab32bb-61b1-4fe2-b209-52caef44a598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=994ded4dc2704bc2870229c8f2e18998, user_id=a913b9b672bb49c5bf553e9552627669, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:40.671938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab32bb-61b1-4fe2-b209-52caef44a598 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:40.687303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1156/2341] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:40 2022] PUT /identity/v3/projects/994ded4dc2704bc2870229c8f2e18998/users/a913b9b672bb49c5bf553e9552627669/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:40.763232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b56726-af0d-437c-9fa7-cc96a6a012fc None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.763512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b56726-af0d-437c-9fa7-cc96a6a012fc None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.763785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b56726-af0d-437c-9fa7-cc96a6a012fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.792491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-27b56726-af0d-437c-9fa7-cc96a6a012fc None None] MFA Rules not processed for user `a913b9b672bb49c5bf553e9552627669`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:40.793683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-27b56726-af0d-437c-9fa7-cc96a6a012fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:40.869175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1186/2342] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:40.881353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab32bb-61b1-4fe2-b209-52caef44a598 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:40.939685 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab32bb-61b1-4fe2-b209-52caef44a598 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:40.943741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d48ec9-bec0-4b74-849b-855e7854e133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:40.944408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48ec9-bec0-4b74-849b-855e7854e133 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:40.944791 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48ec9-bec0-4b74-849b-855e7854e133 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:40.945048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48ec9-bec0-4b74-849b-855e7854e133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:40.953604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d48ec9-bec0-4b74-849b-855e7854e133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:40.955037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d48ec9-bec0-4b74-849b-855e7854e133 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:40.963893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1157/2343] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:43.044879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b56726-af0d-437c-9fa7-cc96a6a012fc None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:43.046453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-27b56726-af0d-437c-9fa7-cc96a6a012fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:43.115745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b56726-af0d-437c-9fa7-cc96a6a012fc None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:43.121487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:43.122127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:43.122405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:43.122695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] PATH_INFO: `/v3/users/9e0392e7a72f4f32af850169e2ffef67` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:43.123828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0392e7a72f4f32af850169e2ffef67)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:43.126155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:43.179645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0392e7a72f4f32af850169e2ffef67'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.180305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0392e7a72f4f32af850169e2ffef67'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.180931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0392e7a72f4f32af850169e2ffef67'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.188077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0392e7a72f4f32af850169e2ffef67'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.200142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0392e7a72f4f32af850169e2ffef67'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.201820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:43.217125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1187/2344] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:43 2022] DELETE /identity/v3/users/9e0392e7a72f4f32af850169e2ffef67 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:43.221624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae0f1d-5084-4cd9-a40d-47bd9b105ac1 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:43.222142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae0f1d-5084-4cd9-a40d-47bd9b105ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:43.222142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae0f1d-5084-4cd9-a40d-47bd9b105ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:43.241729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-06ae0f1d-5084-4cd9-a40d-47bd9b105ac1 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:43.242912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-06ae0f1d-5084-4cd9-a40d-47bd9b105ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:43.270851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:43.310083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1158/2345] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:43.320271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:43.321753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:43.385670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b0a6-8961-41c4-b758-c0f931614a0c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:43.389569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbd26f-0792-4b79-83d8-d7303997c86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:43.390199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbd26f-0792-4b79-83d8-d7303997c86d service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:43.390489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbd26f-0792-4b79-83d8-d7303997c86d service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:43.390750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbd26f-0792-4b79-83d8-d7303997c86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:43.399914 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbd26f-0792-4b79-83d8-d7303997c86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:43.401400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbd26f-0792-4b79-83d8-d7303997c86d service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:43.410889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1188/2346] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:30:43.688569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae0f1d-5084-4cd9-a40d-47bd9b105ac1 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:43.690101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-06ae0f1d-5084-4cd9-a40d-47bd9b105ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:43.702902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae0f1d-5084-4cd9-a40d-47bd9b105ac1 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:43.707723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:43.708362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:43.708666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:43.708976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] PATH_INFO: `/v3/projects/8371882ff4e34fc2953d09886348ad4c` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:43.710126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8371882ff4e34fc2953d09886348ad4c)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:43.713408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:43.763615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8371882ff4e34fc2953d09886348ad4c', 'request_id': 'req-ac2ae683-26b2-4c55-a82a-7d479dc39377'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.770298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8371882ff4e34fc2953d09886348ad4c', 'request_id': 'req-ac2ae683-26b2-4c55-a82a-7d479dc39377'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.779517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8371882ff4e34fc2953d09886348ad4c', 'request_id': 'req-ac2ae683-26b2-4c55-a82a-7d479dc39377'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.790159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] The token cache is being invalidate because project 8371882ff4e34fc2953d09886348ad4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:43.790446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.791620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.793189 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1159/2347] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:43 2022] DELETE /identity/v3/projects/8371882ff4e34fc2953d09886348ad4c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:43.797270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbd26f-0792-4b79-83d8-d7303997c86d service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:43.807708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbd26f-0792-4b79-83d8-d7303997c86d service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:43.865628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:43.866176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:43.866453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:43.866724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] PATH_INFO: `/v3/users/b9bf018ea11f49d29bbd76d802807407` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:43.867910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9bf018ea11f49d29bbd76d802807407)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:43.870474 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:43.926119 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9bf018ea11f49d29bbd76d802807407'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.926793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9bf018ea11f49d29bbd76d802807407'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.927429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9bf018ea11f49d29bbd76d802807407'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.934709 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9bf018ea11f49d29bbd76d802807407'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.947177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dc9ee7bb-da25-4e82-9672-3ddeec382aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9bf018ea11f49d29bbd76d802807407'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:43.961661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1189/2348] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:43 2022] DELETE /identity/v3/users/b9bf018ea11f49d29bbd76d802807407 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:44.247369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:44.249620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:44.266016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ae683-26b2-4c55-a82a-7d479dc39377 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:44.332168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:44.332951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:44.333229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:44.333500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] PATH_INFO: `/v3/projects/504c0f6ba18a430eb326c5ca9b68258b` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:44.334697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=504c0f6ba18a430eb326c5ca9b68258b)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:44.336664 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:44.385582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504c0f6ba18a430eb326c5ca9b68258b', 'request_id': 'req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:44.391748 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504c0f6ba18a430eb326c5ca9b68258b', 'request_id': 'req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:44.394355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:44.402151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504c0f6ba18a430eb326c5ca9b68258b', 'request_id': 'req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:44.413529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] The token cache is being invalidate because project 504c0f6ba18a430eb326c5ca9b68258b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:44.413817 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:44.414571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f77fc936-68f2-4b2f-aa3e-f6537b5085a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:44.416105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1160/2349] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:44 2022] DELETE /identity/v3/projects/504c0f6ba18a430eb326c5ca9b68258b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:44.421142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e648488-88e3-459b-bf10-a9899c60406e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:44.421608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e648488-88e3-459b-bf10-a9899c60406e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:44.421737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e648488-88e3-459b-bf10-a9899c60406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:44.442101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6e648488-88e3-459b-bf10-a9899c60406e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:44.443333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6e648488-88e3-459b-bf10-a9899c60406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:44.452873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:44.509313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1190/2350] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:44.517854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbf949-c05d-4cba-a8eb-88564a5b5a7e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:44.518166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbf949-c05d-4cba-a8eb-88564a5b5a7e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:44.518435 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbf949-c05d-4cba-a8eb-88564a5b5a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:44.538535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f0fbf949-c05d-4cba-a8eb-88564a5b5a7e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:44.539726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f0fbf949-c05d-4cba-a8eb-88564a5b5a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:44.548551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1161/2351] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:44.553123 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e648488-88e3-459b-bf10-a9899c60406e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:44.563442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e648488-88e3-459b-bf10-a9899c60406e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:44.568321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5a11-9845-4317-94e0-1b363c682222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:44.568963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5a11-9845-4317-94e0-1b363c682222 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:44.569247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5a11-9845-4317-94e0-1b363c682222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:44.569519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5a11-9845-4317-94e0-1b363c682222 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:44.570176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb5a11-9845-4317-94e0-1b363c682222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:30:44.570483 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb5a11-9845-4317-94e0-1b363c682222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:44.572151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb5a11-9845-4317-94e0-1b363c682222 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:44.585025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1191/2352] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:30:44.589751 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbf949-c05d-4cba-a8eb-88564a5b5a7e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:44.598842 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbf949-c05d-4cba-a8eb-88564a5b5a7e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:44.604047 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f7b2d-ce73-4cc3-8396-1ceece7c2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:44.604710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f7b2d-ce73-4cc3-8396-1ceece7c2734 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:44.604986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f7b2d-ce73-4cc3-8396-1ceece7c2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:44.605241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f7b2d-ce73-4cc3-8396-1ceece7c2734 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:44.605879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f7b2d-ce73-4cc3-8396-1ceece7c2734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:44.607830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f7b2d-ce73-4cc3-8396-1ceece7c2734 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:44.638969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1162/2353] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:44 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:44.643427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5a11-9845-4317-94e0-1b363c682222 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:44.654417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5a11-9845-4317-94e0-1b363c682222 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:44.717453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb94bc-1129-4c8d-a465-e9815205d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:44.718061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb94bc-1129-4c8d-a465-e9815205d8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:44.718333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb94bc-1129-4c8d-a465-e9815205d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:44.718614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb94bc-1129-4c8d-a465-e9815205d8ef admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:44.719276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb94bc-1129-4c8d-a465-e9815205d8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:44.721322 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb94bc-1129-4c8d-a465-e9815205d8ef admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:44.746357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1192/2354] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:44 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:44.750988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f7b2d-ce73-4cc3-8396-1ceece7c2734 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:44.761699 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f7b2d-ce73-4cc3-8396-1ceece7c2734 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:44.766581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7186311-8d1d-4e46-84c0-8a7e73f4a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:44.767186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7186311-8d1d-4e46-84c0-8a7e73f4a195 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:44.767456 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7186311-8d1d-4e46-84c0-8a7e73f4a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:44.767740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7186311-8d1d-4e46-84c0-8a7e73f4a195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:44.768409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7186311-8d1d-4e46-84c0-8a7e73f4a195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:44.770041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7186311-8d1d-4e46-84c0-8a7e73f4a195 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:44.780329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1163/2355] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:44.784589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb94bc-1129-4c8d-a465-e9815205d8ef admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:44.794872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb94bc-1129-4c8d-a465-e9815205d8ef admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:44.799889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1481f3e-2ee0-4c9f-97c9-92434f8c8101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:44.800486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1481f3e-2ee0-4c9f-97c9-92434f8c8101 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:44.800763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1481f3e-2ee0-4c9f-97c9-92434f8c8101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:44.801030 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1481f3e-2ee0-4c9f-97c9-92434f8c8101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:44.801980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1481f3e-2ee0-4c9f-97c9-92434f8c8101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:44.803594 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1481f3e-2ee0-4c9f-97c9-92434f8c8101 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:44.814694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1193/2356] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:44.819326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7186311-8d1d-4e46-84c0-8a7e73f4a195 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:44.829480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7186311-8d1d-4e46-84c0-8a7e73f4a195 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:44.834980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6404-ecaf-4180-8e39-8effd6df444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:44.835620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6404-ecaf-4180-8e39-8effd6df444a admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:44.835897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6404-ecaf-4180-8e39-8effd6df444a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:44.836203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6404-ecaf-4180-8e39-8effd6df444a admin admin] PATH_INFO: `/v3/projects/0bc04b6468434a2391f95aa7b80ff833/users/5a9c85632f154126a9bca45338f923e1/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:44.857880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe6404-ecaf-4180-8e39-8effd6df444a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc04b6468434a2391f95aa7b80ff833, user_id=5a9c85632f154126a9bca45338f923e1, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:44.860645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe6404-ecaf-4180-8e39-8effd6df444a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:44.876713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1164/2357] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:44 2022] PUT /identity/v3/projects/0bc04b6468434a2391f95aa7b80ff833/users/5a9c85632f154126a9bca45338f923e1/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:44.946428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b8ce6-fe78-4ebd-a86f-a540ad8e3f32 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:44.946658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b8ce6-fe78-4ebd-a86f-a540ad8e3f32 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:44.946934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b8ce6-fe78-4ebd-a86f-a540ad8e3f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:44.977347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-716b8ce6-fe78-4ebd-a86f-a540ad8e3f32 None None] MFA Rules not processed for user `5a9c85632f154126a9bca45338f923e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:44.978638 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-716b8ce6-fe78-4ebd-a86f-a540ad8e3f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:45.052004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1194/2358] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:45.057306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6404-ecaf-4180-8e39-8effd6df444a admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.124893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6404-ecaf-4180-8e39-8effd6df444a admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.130241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558fafc-57e0-4c04-a1b6-7da8f0a75f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.130844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558fafc-57e0-4c04-a1b6-7da8f0a75f11 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.131157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558fafc-57e0-4c04-a1b6-7da8f0a75f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.131425 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558fafc-57e0-4c04-a1b6-7da8f0a75f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.132048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558fafc-57e0-4c04-a1b6-7da8f0a75f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.134002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558fafc-57e0-4c04-a1b6-7da8f0a75f11 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.163026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1165/2359] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:45 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:45.167281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b8ce6-fe78-4ebd-a86f-a540ad8e3f32 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.180152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b8ce6-fe78-4ebd-a86f-a540ad8e3f32 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.186022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:45.240797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c711775-9b2f-419c-8060-fd8dbbd00d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.241672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c711775-9b2f-419c-8060-fd8dbbd00d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.241963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c711775-9b2f-419c-8060-fd8dbbd00d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.242232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c711775-9b2f-419c-8060-fd8dbbd00d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.242864 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c711775-9b2f-419c-8060-fd8dbbd00d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.244998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c711775-9b2f-419c-8060-fd8dbbd00d3c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.270612 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1195/2360] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:45 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:45.274850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558fafc-57e0-4c04-a1b6-7da8f0a75f11 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.285811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558fafc-57e0-4c04-a1b6-7da8f0a75f11 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.290924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17abf52-49a1-46ca-ba12-3e7b4a759c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.291520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17abf52-49a1-46ca-ba12-3e7b4a759c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.291797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17abf52-49a1-46ca-ba12-3e7b4a759c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.292063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17abf52-49a1-46ca-ba12-3e7b4a759c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.292837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17abf52-49a1-46ca-ba12-3e7b4a759c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.294441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17abf52-49a1-46ca-ba12-3e7b4a759c99 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.305236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1166/2361] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:45.309525 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c711775-9b2f-419c-8060-fd8dbbd00d3c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.320272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c711775-9b2f-419c-8060-fd8dbbd00d3c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.325627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cc772-1c63-45de-bf98-56dba30cbab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.326236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cc772-1c63-45de-bf98-56dba30cbab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.326517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cc772-1c63-45de-bf98-56dba30cbab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.326792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cc772-1c63-45de-bf98-56dba30cbab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.327454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cc772-1c63-45de-bf98-56dba30cbab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.329118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cc772-1c63-45de-bf98-56dba30cbab6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.339419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1196/2362] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:45.343748 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17abf52-49a1-46ca-ba12-3e7b4a759c99 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.354432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17abf52-49a1-46ca-ba12-3e7b4a759c99 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.359712 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad3d3e-3306-4341-992a-1d581738115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.360357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad3d3e-3306-4341-992a-1d581738115a admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.360697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad3d3e-3306-4341-992a-1d581738115a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.360954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad3d3e-3306-4341-992a-1d581738115a admin admin] PATH_INFO: `/v3/projects/ca3aeca9bf67481dbdbf719a19e00a43/users/4cf847a323644b4db786d3cb497255b3/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.380973 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad3d3e-3306-4341-992a-1d581738115a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3aeca9bf67481dbdbf719a19e00a43, user_id=4cf847a323644b4db786d3cb497255b3, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.383665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad3d3e-3306-4341-992a-1d581738115a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.404043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1167/2363] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:45 2022] PUT /identity/v3/projects/ca3aeca9bf67481dbdbf719a19e00a43/users/4cf847a323644b4db786d3cb497255b3/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:30:45.415772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5146a-7143-440f-8dfc-5222a7337362 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.416770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5146a-7143-440f-8dfc-5222a7337362 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.417120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5146a-7143-440f-8dfc-5222a7337362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.448069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-a5f5146a-7143-440f-8dfc-5222a7337362 None None] MFA Rules not processed for user `4cf847a323644b4db786d3cb497255b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:45.449418 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a5f5146a-7143-440f-8dfc-5222a7337362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:45.521552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1197/2364] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:45.526340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad3d3e-3306-4341-992a-1d581738115a admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.561083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:45.591254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad3d3e-3306-4341-992a-1d581738115a admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.596329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54e1a2-7d49-495c-aba5-33af6941b5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.596960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54e1a2-7d49-495c-aba5-33af6941b5db admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.597235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54e1a2-7d49-495c-aba5-33af6941b5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.597498 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54e1a2-7d49-495c-aba5-33af6941b5db admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.598135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54e1a2-7d49-495c-aba5-33af6941b5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.600032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54e1a2-7d49-495c-aba5-33af6941b5db admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.629959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1168/2365] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:45 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:30:45.637207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5146a-7143-440f-8dfc-5222a7337362 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.648501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5146a-7143-440f-8dfc-5222a7337362 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.707868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e777-8a58-4f04-8cac-bb73419b3853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.708508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e777-8a58-4f04-8cac-bb73419b3853 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.708792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e777-8a58-4f04-8cac-bb73419b3853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.709062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e777-8a58-4f04-8cac-bb73419b3853 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.709698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6e777-8a58-4f04-8cac-bb73419b3853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.711665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6e777-8a58-4f04-8cac-bb73419b3853 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.736460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1198/2366] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:45 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:45.740694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54e1a2-7d49-495c-aba5-33af6941b5db admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.752398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54e1a2-7d49-495c-aba5-33af6941b5db admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.757262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4acf3-5d42-4190-94c4-0016ec2df6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.757870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4acf3-5d42-4190-94c4-0016ec2df6fe admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.758149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4acf3-5d42-4190-94c4-0016ec2df6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.758424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4acf3-5d42-4190-94c4-0016ec2df6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.759078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4acf3-5d42-4190-94c4-0016ec2df6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.760854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4acf3-5d42-4190-94c4-0016ec2df6fe admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.771968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1169/2367] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:45.776670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e777-8a58-4f04-8cac-bb73419b3853 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.787282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e777-8a58-4f04-8cac-bb73419b3853 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.792842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58426c8-d847-4288-b65e-e59f6188fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.793493 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58426c8-d847-4288-b65e-e59f6188fdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.793768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58426c8-d847-4288-b65e-e59f6188fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.794050 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58426c8-d847-4288-b65e-e59f6188fdd8 admin admin] PATH_INFO: `/v3/projects/2b8099433b4e44c9a6476b16b2ed8b55/users/312fa389a49b4c648d5c538b76042974/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.796278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:45.811740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58426c8-d847-4288-b65e-e59f6188fdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8099433b4e44c9a6476b16b2ed8b55, user_id=312fa389a49b4c648d5c538b76042974, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.814477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58426c8-d847-4288-b65e-e59f6188fdd8 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.834329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1199/2368] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:45 2022] PUT /identity/v3/projects/2b8099433b4e44c9a6476b16b2ed8b55/users/312fa389a49b4c648d5c538b76042974/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:45.838665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4acf3-5d42-4190-94c4-0016ec2df6fe admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.848874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4acf3-5d42-4190-94c4-0016ec2df6fe admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.909320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfb579-52a6-4f6b-9543-b77f0c6bbc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.909926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfb579-52a6-4f6b-9543-b77f0c6bbc5e admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.910206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfb579-52a6-4f6b-9543-b77f0c6bbc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.910479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfb579-52a6-4f6b-9543-b77f0c6bbc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.911127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfb579-52a6-4f6b-9543-b77f0c6bbc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.912766 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfb579-52a6-4f6b-9543-b77f0c6bbc5e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.923124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1170/2369] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:45.929592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58426c8-d847-4288-b65e-e59f6188fdd8 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:45.941712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58426c8-d847-4288-b65e-e59f6188fdd8 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:45.947506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312ea63-0455-425e-8248-97a02b25c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:45.948207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312ea63-0455-425e-8248-97a02b25c24c admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.948509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312ea63-0455-425e-8248-97a02b25c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.948798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312ea63-0455-425e-8248-97a02b25c24c admin admin] PATH_INFO: `/v3/projects/2b8099433b4e44c9a6476b16b2ed8b55/users/312fa389a49b4c648d5c538b76042974/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:45.950882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312ea63-0455-425e-8248-97a02b25c24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8099433b4e44c9a6476b16b2ed8b55, user_id=312fa389a49b4c648d5c538b76042974, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:45.953618 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312ea63-0455-425e-8248-97a02b25c24c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:45.964904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1200/2370] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:45 2022] PUT /identity/v3/projects/2b8099433b4e44c9a6476b16b2ed8b55/users/312fa389a49b4c648d5c538b76042974/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:45.975350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9c4b-bf21-469a-b5b2-172ae849458c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:45.975631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9c4b-bf21-469a-b5b2-172ae849458c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:45.975902 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9c4b-bf21-469a-b5b2-172ae849458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:46.004872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-342c9c4b-bf21-469a-b5b2-172ae849458c None None] MFA Rules not processed for user `312fa389a49b4c648d5c538b76042974`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:46.006058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-342c9c4b-bf21-469a-b5b2-172ae849458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:46.073466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1171/2371] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:46.084997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312ea63-0455-425e-8248-97a02b25c24c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:46.086846 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5312ea63-0455-425e-8248-97a02b25c24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:46.148965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312ea63-0455-425e-8248-97a02b25c24c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:46.153330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d003d-18c4-4875-a1bb-2e5537261e8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:46.153941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d003d-18c4-4875-a1bb-2e5537261e8c service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:46.154222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d003d-18c4-4875-a1bb-2e5537261e8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:46.154494 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d003d-18c4-4875-a1bb-2e5537261e8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:46.164200 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d003d-18c4-4875-a1bb-2e5537261e8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:46.165761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d003d-18c4-4875-a1bb-2e5537261e8c service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:46.175815 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1201/2372] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:46.231938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9c4b-bf21-469a-b5b2-172ae849458c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:46.233491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-342c9c4b-bf21-469a-b5b2-172ae849458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:46.247161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9c4b-bf21-469a-b5b2-172ae849458c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:46.252003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2903578-dad1-4ee0-99bb-6d2e61a7b89b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:46.252651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2903578-dad1-4ee0-99bb-6d2e61a7b89b service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:46.252929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2903578-dad1-4ee0-99bb-6d2e61a7b89b service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:46.253199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2903578-dad1-4ee0-99bb-6d2e61a7b89b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:46.278669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:46.311673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2903578-dad1-4ee0-99bb-6d2e61a7b89b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:46.313163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2903578-dad1-4ee0-99bb-6d2e61a7b89b service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:46.322557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1172/2373] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:53.571346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d003d-18c4-4875-a1bb-2e5537261e8c service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:53.655792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d003d-18c4-4875-a1bb-2e5537261e8c service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:53.663279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:53.664219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:53.664776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:53.665266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] PATH_INFO: `/v3/users/5a9c85632f154126a9bca45338f923e1` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:53.670077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9c85632f154126a9bca45338f923e1)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:53.672057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:53.734994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9c85632f154126a9bca45338f923e1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:53.735728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9c85632f154126a9bca45338f923e1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:53.736534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9c85632f154126a9bca45338f923e1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:53.748814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9c85632f154126a9bca45338f923e1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:53.765312 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9c85632f154126a9bca45338f923e1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:53.767110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:53.787089 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1202/2374] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:53 2022] DELETE /identity/v3/users/5a9c85632f154126a9bca45338f923e1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:53.792821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fb2e8-5dea-4686-8a03-3a425b554006 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:53.793338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fb2e8-5dea-4686-8a03-3a425b554006 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:53.793338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fb2e8-5dea-4686-8a03-3a425b554006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:53.814884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-401fb2e8-5dea-4686-8a03-3a425b554006 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:53.816098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-401fb2e8-5dea-4686-8a03-3a425b554006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:53.891515 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1173/2375] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:53.902356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:53.903960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:53.978461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6811a23-12f4-4b09-a5a6-38bc886d8685 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:53.983154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4cead-9f09-4122-aaa9-fbf77d0c6334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:53.983767 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4cead-9f09-4122-aaa9-fbf77d0c6334 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:53.984032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4cead-9f09-4122-aaa9-fbf77d0c6334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:53.984306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4cead-9f09-4122-aaa9-fbf77d0c6334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:53.994697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4cead-9f09-4122-aaa9-fbf77d0c6334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:53.996158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4cead-9f09-4122-aaa9-fbf77d0c6334 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:54.008095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1203/2376] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:54.326958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fb2e8-5dea-4686-8a03-3a425b554006 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:54.329103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-401fb2e8-5dea-4686-8a03-3a425b554006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:54.342259 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fb2e8-5dea-4686-8a03-3a425b554006 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:54.358839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:54.359505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:54.359784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:54.360124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] PATH_INFO: `/v3/projects/0bc04b6468434a2391f95aa7b80ff833` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:54.361367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc04b6468434a2391f95aa7b80ff833)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:54.363377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:54.413268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc04b6468434a2391f95aa7b80ff833', 'request_id': 'req-4dcce119-17d4-44bd-b302-92d9a8d1cc85'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:54.419602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc04b6468434a2391f95aa7b80ff833', 'request_id': 'req-4dcce119-17d4-44bd-b302-92d9a8d1cc85'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:54.428350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc04b6468434a2391f95aa7b80ff833', 'request_id': 'req-4dcce119-17d4-44bd-b302-92d9a8d1cc85'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:54.441487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] The token cache is being invalidate because project 0bc04b6468434a2391f95aa7b80ff833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:54.441772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:54.442458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:54.444006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1174/2377] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:54 2022] DELETE /identity/v3/projects/0bc04b6468434a2391f95aa7b80ff833 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:54.448576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4cead-9f09-4122-aaa9-fbf77d0c6334 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:54.462276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4cead-9f09-4122-aaa9-fbf77d0c6334 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:54.523327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:54.523969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:54.524249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:54.524563 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] PATH_INFO: `/v3/users/4cf847a323644b4db786d3cb497255b3` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:54.525739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf847a323644b4db786d3cb497255b3)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:54.527735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:54.577321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf847a323644b4db786d3cb497255b3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:54.577999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf847a323644b4db786d3cb497255b3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:54.578687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf847a323644b4db786d3cb497255b3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:54.586018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf847a323644b4db786d3cb497255b3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:54.598611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf847a323644b4db786d3cb497255b3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:54.612994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1204/2378] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:54 2022] DELETE /identity/v3/users/4cf847a323644b4db786d3cb497255b3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:54.897682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:54.899249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:54.920864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce119-17d4-44bd-b302-92d9a8d1cc85 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:54.969746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:54.984297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:54.984974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:54.985254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:54.985533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] PATH_INFO: `/v3/projects/ca3aeca9bf67481dbdbf719a19e00a43` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:54.986695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3aeca9bf67481dbdbf719a19e00a43)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:54.988685 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:55.041770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3aeca9bf67481dbdbf719a19e00a43', 'request_id': 'req-9b5f4b53-7717-489c-801a-db0bb7c334bb'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.047913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3aeca9bf67481dbdbf719a19e00a43', 'request_id': 'req-9b5f4b53-7717-489c-801a-db0bb7c334bb'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.057624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3aeca9bf67481dbdbf719a19e00a43', 'request_id': 'req-9b5f4b53-7717-489c-801a-db0bb7c334bb'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.069021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] The token cache is being invalidate because project ca3aeca9bf67481dbdbf719a19e00a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:55.069315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.070024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.071629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1175/2379] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:54 2022] DELETE /identity/v3/projects/ca3aeca9bf67481dbdbf719a19e00a43 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:55.075871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:55.077384 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:55.090202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa95113-5914-4ef0-bdc9-cb0a96c0f483 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:55.100007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:55.153321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:55.153955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:55.154236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:55.154506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] PATH_INFO: `/v3/users/312fa389a49b4c648d5c538b76042974` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:55.155648 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312fa389a49b4c648d5c538b76042974)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:55.157628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:55.208242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312fa389a49b4c648d5c538b76042974'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.209081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312fa389a49b4c648d5c538b76042974'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.209700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312fa389a49b4c648d5c538b76042974'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.217104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312fa389a49b4c648d5c538b76042974'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.229297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-861dddc0-4a6c-4e12-8e1e-c58637e6adc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312fa389a49b4c648d5c538b76042974'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.243969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1205/2380] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:55 2022] DELETE /identity/v3/users/312fa389a49b4c648d5c538b76042974 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:55.535594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:55.537136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:55.551779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f4b53-7717-489c-801a-db0bb7c334bb admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:55.611299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:55.611960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:55.612229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:55.612544 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] PATH_INFO: `/v3/projects/2b8099433b4e44c9a6476b16b2ed8b55` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:55.613792 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8099433b4e44c9a6476b16b2ed8b55)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:55.615785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:55.666645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8099433b4e44c9a6476b16b2ed8b55', 'request_id': 'req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.673228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8099433b4e44c9a6476b16b2ed8b55', 'request_id': 'req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.683076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8099433b4e44c9a6476b16b2ed8b55', 'request_id': 'req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.694246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] The token cache is being invalidate because project 2b8099433b4e44c9a6476b16b2ed8b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:55.694534 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.695222 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ff8ab527-c239-42cf-9e06-d9f3e00f3f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:55.696761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1176/2381] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:55 2022] DELETE /identity/v3/projects/2b8099433b4e44c9a6476b16b2ed8b55 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:55.703023 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67496-3512-4343-a926-945e20497d9e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:55.703521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67496-3512-4343-a926-945e20497d9e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:55.703636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67496-3512-4343-a926-945e20497d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:55.723690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5ec67496-3512-4343-a926-945e20497d9e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:55.724909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5ec67496-3512-4343-a926-945e20497d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:55.786605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1206/2382] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:55.796611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac662cc-a52a-4ec4-bf8c-4fd88c48a9cf None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:55.796923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac662cc-a52a-4ec4-bf8c-4fd88c48a9cf None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:55.797174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac662cc-a52a-4ec4-bf8c-4fd88c48a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:55.818246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-7ac662cc-a52a-4ec4-bf8c-4fd88c48a9cf None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:55.819419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7ac662cc-a52a-4ec4-bf8c-4fd88c48a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:55.830315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1177/2383] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:55.834772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67496-3512-4343-a926-945e20497d9e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:55.845337 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67496-3512-4343-a926-945e20497d9e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:55.850539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c12617-7f01-4e6d-b50b-9a966ad610b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:55.851115 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c12617-7f01-4e6d-b50b-9a966ad610b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:55.851395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c12617-7f01-4e6d-b50b-9a966ad610b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:55.851669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c12617-7f01-4e6d-b50b-9a966ad610b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:55.852323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c12617-7f01-4e6d-b50b-9a966ad610b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:30:55.852661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c12617-7f01-4e6d-b50b-9a966ad610b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:55.854373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c12617-7f01-4e6d-b50b-9a966ad610b5 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:55.866380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1207/2384] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:30:55.870907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac662cc-a52a-4ec4-bf8c-4fd88c48a9cf None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:55.875789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:55.881861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac662cc-a52a-4ec4-bf8c-4fd88c48a9cf None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:55.888836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38931c2-b7d0-465a-acff-62dddd689093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:55.889451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38931c2-b7d0-465a-acff-62dddd689093 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:55.889739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38931c2-b7d0-465a-acff-62dddd689093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:55.890023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38931c2-b7d0-465a-acff-62dddd689093 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:55.890687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38931c2-b7d0-465a-acff-62dddd689093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:55.893017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38931c2-b7d0-465a-acff-62dddd689093 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:55.923483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1178/2385] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:30:55 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:30:55.927854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c12617-7f01-4e6d-b50b-9a966ad610b5 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:55.938721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c12617-7f01-4e6d-b50b-9a966ad610b5 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:55.956453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:56.000047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7aada-a9dc-4e52-aeb8-348fe346704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:56.000817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7aada-a9dc-4e52-aeb8-348fe346704a admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:56.001093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7aada-a9dc-4e52-aeb8-348fe346704a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:56.001360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7aada-a9dc-4e52-aeb8-348fe346704a admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:56.002003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7aada-a9dc-4e52-aeb8-348fe346704a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:56.003962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7aada-a9dc-4e52-aeb8-348fe346704a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:56.031038 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1208/2386] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:30:55 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:30:56.035360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38931c2-b7d0-465a-acff-62dddd689093 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:56.046170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38931c2-b7d0-465a-acff-62dddd689093 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:56.051913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aba0c9-fb2a-43c5-b7d7-4187b114722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:56.052549 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aba0c9-fb2a-43c5-b7d7-4187b114722f admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:56.052830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aba0c9-fb2a-43c5-b7d7-4187b114722f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:56.053100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aba0c9-fb2a-43c5-b7d7-4187b114722f admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:56.053749 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aba0c9-fb2a-43c5-b7d7-4187b114722f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:56.055363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aba0c9-fb2a-43c5-b7d7-4187b114722f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:56.065511 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1179/2387] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:56.069777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7aada-a9dc-4e52-aeb8-348fe346704a admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:56.083165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7aada-a9dc-4e52-aeb8-348fe346704a admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:56.090250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a84da-3edc-4c07-a93f-c2f7f2b0bca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:56.090816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a84da-3edc-4c07-a93f-c2f7f2b0bca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:56.091131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a84da-3edc-4c07-a93f-c2f7f2b0bca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:56.091387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a84da-3edc-4c07-a93f-c2f7f2b0bca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:56.092062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a84da-3edc-4c07-a93f-c2f7f2b0bca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:56.093735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a84da-3edc-4c07-a93f-c2f7f2b0bca5 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:56.104853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1209/2388] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:30:56.109656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aba0c9-fb2a-43c5-b7d7-4187b114722f admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:56.126947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aba0c9-fb2a-43c5-b7d7-4187b114722f admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:56.135705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5fc11-4d93-4196-a426-4c31d06f2a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:56.136351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5fc11-4d93-4196-a426-4c31d06f2a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:56.136667 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5fc11-4d93-4196-a426-4c31d06f2a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:56.136935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5fc11-4d93-4196-a426-4c31d06f2a36 admin admin] PATH_INFO: `/v3/projects/b3d1c9d5c4f64defb5bbc0ff2c0f5972/users/875796f323be4c0f803c80c068875622/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:56.153551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5fc11-4d93-4196-a426-4c31d06f2a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d1c9d5c4f64defb5bbc0ff2c0f5972, user_id=875796f323be4c0f803c80c068875622, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:56.156236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5fc11-4d93-4196-a426-4c31d06f2a36 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:56.172317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1180/2389] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:30:56 2022] PUT /identity/v3/projects/b3d1c9d5c4f64defb5bbc0ff2c0f5972/users/875796f323be4c0f803c80c068875622/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:56.187587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c99c9-c620-4ef7-aaea-ba1e8522090d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:56.187854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c99c9-c620-4ef7-aaea-ba1e8522090d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:56.188146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c99c9-c620-4ef7-aaea-ba1e8522090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:56.217488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-310c99c9-c620-4ef7-aaea-ba1e8522090d None None] MFA Rules not processed for user `875796f323be4c0f803c80c068875622`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:56.218705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-310c99c9-c620-4ef7-aaea-ba1e8522090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:56.290343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1210/2390] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:56.302525 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5fc11-4d93-4196-a426-4c31d06f2a36 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:56.304432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d6e5fc11-4d93-4196-a426-4c31d06f2a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:56.369643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5fc11-4d93-4196-a426-4c31d06f2a36 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:56.374211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879d0f5-cd78-48af-9cb3-d44d6ad1cbc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:56.375171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879d0f5-cd78-48af-9cb3-d44d6ad1cbc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:56.375447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879d0f5-cd78-48af-9cb3-d44d6ad1cbc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:56.375714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879d0f5-cd78-48af-9cb3-d44d6ad1cbc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:56.384785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879d0f5-cd78-48af-9cb3-d44d6ad1cbc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:56.386235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879d0f5-cd78-48af-9cb3-d44d6ad1cbc1 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:56.395656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1181/2391] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:56.425042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c99c9-c620-4ef7-aaea-ba1e8522090d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:56.493619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c99c9-c620-4ef7-aaea-ba1e8522090d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:56.499197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:56.500230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:56.500537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:56.500807 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] PATH_INFO: `/v3/users/875796f323be4c0f803c80c068875622` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:56.501981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=875796f323be4c0f803c80c068875622)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:56.503983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:56.541360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:56.556157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875796f323be4c0f803c80c068875622'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:56.556860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875796f323be4c0f803c80c068875622'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:56.557479 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875796f323be4c0f803c80c068875622'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:56.565763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875796f323be4c0f803c80c068875622'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:56.578331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875796f323be4c0f803c80c068875622'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:56.592846 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1211/2392] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:30:56 2022] DELETE /identity/v3/users/875796f323be4c0f803c80c068875622 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:30:56.597524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb0744-fd2f-4f0f-8e44-8d8e60dc6441 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:56.597812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb0744-fd2f-4f0f-8e44-8d8e60dc6441 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:56.598084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb0744-fd2f-4f0f-8e44-8d8e60dc6441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:56.617874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e9cb0744-fd2f-4f0f-8e44-8d8e60dc6441 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:56.619067 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e9cb0744-fd2f-4f0f-8e44-8d8e60dc6441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:56.682897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1182/2393] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:56.695463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:56.697851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:56.761143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8f2a7-0778-4e89-b4cc-45fa918e23d6 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:56.765270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3db9b-80f4-4f60-95e3-0b671da0ea0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:56.765887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3db9b-80f4-4f60-95e3-0b671da0ea0f service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:56.766169 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3db9b-80f4-4f60-95e3-0b671da0ea0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:56.766447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3db9b-80f4-4f60-95e3-0b671da0ea0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:56.777357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3db9b-80f4-4f60-95e3-0b671da0ea0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:56.778833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3db9b-80f4-4f60-95e3-0b671da0ea0f service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:56.788287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1212/2394] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:57.092053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb0744-fd2f-4f0f-8e44-8d8e60dc6441 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:57.093709 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e9cb0744-fd2f-4f0f-8e44-8d8e60dc6441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:57.107532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb0744-fd2f-4f0f-8e44-8d8e60dc6441 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:57.113529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:57.114175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:57.114449 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:57.114712 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] PATH_INFO: `/v3/projects/b3d1c9d5c4f64defb5bbc0ff2c0f5972` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:57.115958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d1c9d5c4f64defb5bbc0ff2c0f5972)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:57.117942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:57.174594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:57.178448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d1c9d5c4f64defb5bbc0ff2c0f5972', 'request_id': 'req-2ffbd565-0aac-408a-bd29-ea29baf60113'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:57.188055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d1c9d5c4f64defb5bbc0ff2c0f5972', 'request_id': 'req-2ffbd565-0aac-408a-bd29-ea29baf60113'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:57.197399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d1c9d5c4f64defb5bbc0ff2c0f5972', 'request_id': 'req-2ffbd565-0aac-408a-bd29-ea29baf60113'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:57.208028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] The token cache is being invalidate because project b3d1c9d5c4f64defb5bbc0ff2c0f5972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:30:57.208314 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:57.209022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-2ffbd565-0aac-408a-bd29-ea29baf60113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:30:57.210521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1183/2395] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:30:57 2022] DELETE /identity/v3/projects/b3d1c9d5c4f64defb5bbc0ff2c0f5972 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:31:03.629063 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3db9b-80f4-4f60-95e3-0b671da0ea0f service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:31:03.631262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-74f3db9b-80f4-4f60-95e3-0b671da0ea0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:03.648242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3db9b-80f4-4f60-95e3-0b671da0ea0f service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:31:03.714175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:31:03.714802 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:31:03.715073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:31:03.715345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] PATH_INFO: `/v3/users/a913b9b672bb49c5bf553e9552627669` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:31:03.716545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a913b9b672bb49c5bf553e9552627669)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:31:03.718696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:31:03.768917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a913b9b672bb49c5bf553e9552627669'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:31:03.769592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a913b9b672bb49c5bf553e9552627669'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:31:03.770233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a913b9b672bb49c5bf553e9552627669'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:31:03.774880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:31:03.778560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a913b9b672bb49c5bf553e9552627669'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:31:03.792447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a913b9b672bb49c5bf553e9552627669'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:31:03.807664 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1213/2396] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:31:03 2022] DELETE /identity/v3/users/a913b9b672bb49c5bf553e9552627669 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:31:03.812514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9da1d-db35-4265-9c70-451b70867f68 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:31:03.813005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9da1d-db35-4265-9c70-451b70867f68 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:31:03.813122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9da1d-db35-4265-9c70-451b70867f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:31:03.836006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6ab9da1d-db35-4265-9c70-451b70867f68 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:31:03.837243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6ab9da1d-db35-4265-9c70-451b70867f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:03.901222 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1184/2397] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:31:03.913400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:31:03.915916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:03.977166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3cd5b-1b1e-46bd-b0ab-1421642fcec6 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:31:03.981852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792dc81-18cb-4af8-b339-18e3e08eaffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:31:03.982457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792dc81-18cb-4af8-b339-18e3e08eaffb service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:31:03.982734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792dc81-18cb-4af8-b339-18e3e08eaffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:31:03.983006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792dc81-18cb-4af8-b339-18e3e08eaffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:31:03.995072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792dc81-18cb-4af8-b339-18e3e08eaffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:31:03.996581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792dc81-18cb-4af8-b339-18e3e08eaffb service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:31:04.006946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1214/2398] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:31:04.281659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9da1d-db35-4265-9c70-451b70867f68 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:31:04.283209 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6ab9da1d-db35-4265-9c70-451b70867f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:04.297146 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9da1d-db35-4265-9c70-451b70867f68 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:31:04.303172 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:31:04.303942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:31:04.304084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:31:04.304431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] PATH_INFO: `/v3/projects/994ded4dc2704bc2870229c8f2e18998` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:31:04.305514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=994ded4dc2704bc2870229c8f2e18998)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:31:04.307448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:31:04.356855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994ded4dc2704bc2870229c8f2e18998', 'request_id': 'req-5256b136-11d4-4344-992b-aa1dbdb1c6e1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:31:04.364100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994ded4dc2704bc2870229c8f2e18998', 'request_id': 'req-5256b136-11d4-4344-992b-aa1dbdb1c6e1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:31:04.375026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994ded4dc2704bc2870229c8f2e18998', 'request_id': 'req-5256b136-11d4-4344-992b-aa1dbdb1c6e1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:31:04.386974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] The token cache is being invalidate because project 994ded4dc2704bc2870229c8f2e18998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:31:04.387262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:31:04.387951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:31:04.389542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1185/2399] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:31:04 2022] DELETE /identity/v3/projects/994ded4dc2704bc2870229c8f2e18998 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:31:14.002716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=36,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:31:14.383854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:31:37.861509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8cca-f157-4a92-978f-edf021e17002 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:31:37.862152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8cca-f157-4a92-978f-edf021e17002 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:31:37.862152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8cca-f157-4a92-978f-edf021e17002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:31:37.882805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-659d8cca-f157-4a92-978f-edf021e17002 None None] MFA Rules not processed for user `92f0c702f8ce49a99a10175b0ce68685`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:31:37.884003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-659d8cca-f157-4a92-978f-edf021e17002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:37.944753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1215/2400] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:31:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:31:47.934830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=25 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:31:50.417010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:31:50.418562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:50.486414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256b136-11d4-4344-992b-aa1dbdb1c6e1 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:31:50.490639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f70889-ce5d-446f-a780-3dd954dbf150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:31:50.491243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f70889-ce5d-446f-a780-3dd954dbf150 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:31:50.491520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f70889-ce5d-446f-a780-3dd954dbf150 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:31:50.491815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f70889-ce5d-446f-a780-3dd954dbf150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:31:50.493657 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a1f70889-ce5d-446f-a780-3dd954dbf150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:50.568420 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f70889-ce5d-446f-a780-3dd954dbf150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:31:50.569869 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f70889-ce5d-446f-a780-3dd954dbf150 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:31:50.581373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1186/2401] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:31:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:31:50.761292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8cca-f157-4a92-978f-edf021e17002 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:31:50.762906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-659d8cca-f157-4a92-978f-edf021e17002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:50.775388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8cca-f157-4a92-978f-edf021e17002 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:31:50.779208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433bfa-da33-41ec-9d66-2d82cc76c21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:31:50.779851 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433bfa-da33-41ec-9d66-2d82cc76c21d service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:31:50.780120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433bfa-da33-41ec-9d66-2d82cc76c21d service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:31:50.780414 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433bfa-da33-41ec-9d66-2d82cc76c21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:31:50.782219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b9433bfa-da33-41ec-9d66-2d82cc76c21d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:50.795700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433bfa-da33-41ec-9d66-2d82cc76c21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:31:50.797175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433bfa-da33-41ec-9d66-2d82cc76c21d service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:31:50.808147 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1216/2402] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:31:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:32:00.576117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=54 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:32:00.803355 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=6 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:32:13.691630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f70889-ce5d-446f-a780-3dd954dbf150 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:32:13.694011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a1f70889-ce5d-446f-a780-3dd954dbf150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:32:13.711445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f70889-ce5d-446f-a780-3dd954dbf150 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:32:13.717505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35fe5a-9e44-46e5-a971-0cde7b2e68dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:32:13.718107 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35fe5a-9e44-46e5-a971-0cde7b2e68dc service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:32:13.718384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35fe5a-9e44-46e5-a971-0cde7b2e68dc service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:32:13.718648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35fe5a-9e44-46e5-a971-0cde7b2e68dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:32:13.720680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7d35fe5a-9e44-46e5-a971-0cde7b2e68dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:32:13.787911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35fe5a-9e44-46e5-a971-0cde7b2e68dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:32:13.789567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35fe5a-9e44-46e5-a971-0cde7b2e68dc service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:32:13.798616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1187/2403] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:32:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:32:22.078562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433bfa-da33-41ec-9d66-2d82cc76c21d service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:32:22.088149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433bfa-da33-41ec-9d66-2d82cc76c21d service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:32:22.092650 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4013f-cdf8-40ae-add9-6d0a11d842a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:32:22.093271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4013f-cdf8-40ae-add9-6d0a11d842a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:32:22.093539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4013f-cdf8-40ae-add9-6d0a11d842a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:32:22.093795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4013f-cdf8-40ae-add9-6d0a11d842a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:32:22.095685 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-80d4013f-cdf8-40ae-add9-6d0a11d842a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:32:22.106366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4013f-cdf8-40ae-add9-6d0a11d842a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:32:22.107849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4013f-cdf8-40ae-add9-6d0a11d842a2 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:32:22.117026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1217/2404] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:32:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:32:23.794513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=28 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:32:32.113673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=6 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:32:42.446095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cdb50-8959-4199-afb7-fb0d99c5633b None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:32:42.446678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cdb50-8959-4199-afb7-fb0d99c5633b None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:32:42.446678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cdb50-8959-4199-afb7-fb0d99c5633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:32:42.467867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-c42cdb50-8959-4199-afb7-fb0d99c5633b None None] MFA Rules not processed for user `e4681e0753e84aea8d453465a424e2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:32:42.469113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c42cdb50-8959-4199-afb7-fb0d99c5633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:32:42.477286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1188/2405] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:32:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:32:44.980556 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4013f-cdf8-40ae-add9-6d0a11d842a2 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:32:44.995595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4013f-cdf8-40ae-add9-6d0a11d842a2 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:32:45.007560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b0230-022e-4c79-a3e6-22293705fb98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:32:45.008145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b0230-022e-4c79-a3e6-22293705fb98 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:32:45.008422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b0230-022e-4c79-a3e6-22293705fb98 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:32:45.008718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b0230-022e-4c79-a3e6-22293705fb98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:32:45.010651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-fb4b0230-022e-4c79-a3e6-22293705fb98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:32:45.078365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b0230-022e-4c79-a3e6-22293705fb98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:32:45.079903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b0230-022e-4c79-a3e6-22293705fb98 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:32:45.089654 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1218/2406] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:32:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:32:48.917421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cdb50-8959-4199-afb7-fb0d99c5633b None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:32:48.918924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c42cdb50-8959-4199-afb7-fb0d99c5633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:32:48.935472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cdb50-8959-4199-afb7-fb0d99c5633b None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:32:48.950297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc21068-f7d8-4402-ab0c-f9748f4ba23d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:32:48.950924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc21068-f7d8-4402-ab0c-f9748f4ba23d service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:32:48.951196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc21068-f7d8-4402-ab0c-f9748f4ba23d service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:32:48.951461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc21068-f7d8-4402-ab0c-f9748f4ba23d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:32:48.953428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5dc21068-f7d8-4402-ab0c-f9748f4ba23d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:32:48.970258 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc21068-f7d8-4402-ab0c-f9748f4ba23d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:32:48.971936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc21068-f7d8-4402-ab0c-f9748f4ba23d service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:32:48.988607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1189/2407] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:32:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:32:55.085336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=28 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:32:58.979141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=9 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:18.863759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b0230-022e-4c79-a3e6-22293705fb98 service nova] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:18.881519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b0230-022e-4c79-a3e6-22293705fb98 service nova] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:18.889114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6417a-4118-4628-ae99-40c7d2ac3135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:18.889716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6417a-4118-4628-ae99-40c7d2ac3135 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:18.889988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6417a-4118-4628-ae99-40c7d2ac3135 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:18.890250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6417a-4118-4628-ae99-40c7d2ac3135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:18.892323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cef6417a-4118-4628-ae99-40c7d2ac3135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:18.904417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6417a-4118-4628-ae99-40c7d2ac3135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:18.906051 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6417a-4118-4628-ae99-40c7d2ac3135 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:18.916174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1219/2408] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:22.457925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc21068-f7d8-4402-ab0c-f9748f4ba23d service nova] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:22.469213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc21068-f7d8-4402-ab0c-f9748f4ba23d service nova] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:22.476556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0bf93-efef-49c8-8567-397fe0987b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:22.477175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0bf93-efef-49c8-8567-397fe0987b7e service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:22.477448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0bf93-efef-49c8-8567-397fe0987b7e service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:22.477717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0bf93-efef-49c8-8567-397fe0987b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:22.479486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c3e0bf93-efef-49c8-8567-397fe0987b7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:22.492867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0bf93-efef-49c8-8567-397fe0987b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:22.494448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0bf93-efef-49c8-8567-397fe0987b7e service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:22.506309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1190/2409] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:25.180187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6417a-4118-4628-ae99-40c7d2ac3135 service nova] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:25.190043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6417a-4118-4628-ae99-40c7d2ac3135 service nova] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:25.194482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554c535-7b65-46e8-9e34-34b3ce1ff4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:25.195079 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554c535-7b65-46e8-9e34-34b3ce1ff4fc service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:25.195358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554c535-7b65-46e8-9e34-34b3ce1ff4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:25.195633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554c535-7b65-46e8-9e34-34b3ce1ff4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:25.197658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7554c535-7b65-46e8-9e34-34b3ce1ff4fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:25.207459 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554c535-7b65-46e8-9e34-34b3ce1ff4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:25.208952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554c535-7b65-46e8-9e34-34b3ce1ff4fc service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:25.217095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1220/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:25.355108 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6be45-0420-47f8-ac90-3ab29cc981bd None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:25.355668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6be45-0420-47f8-ac90-3ab29cc981bd None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:25.355668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6be45-0420-47f8-ac90-3ab29cc981bd None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:25.357106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1191/2411] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:33:25.364589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519158-15f7-49a2-8d40-8ae2be66a1ea None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:25.365328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519158-15f7-49a2-8d40-8ae2be66a1ea None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:25.365328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519158-15f7-49a2-8d40-8ae2be66a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:25.387829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d3519158-15f7-49a2-8d40-8ae2be66a1ea None None] MFA Rules not processed for user `32ca32d96f9a436782ef0680f6b5dcac`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:25.389158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d3519158-15f7-49a2-8d40-8ae2be66a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:25.397652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1221/2412] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:33:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:25.416034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6be45-0420-47f8-ac90-3ab29cc981bd None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:25.430706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6be45-0420-47f8-ac90-3ab29cc981bd None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:25.434764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0e749-3b72-421d-9708-2e2f6d9d5dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:25.435732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e749-3b72-421d-9708-2e2f6d9d5dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:25.436010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e749-3b72-421d-9708-2e2f6d9d5dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:25.436287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e749-3b72-421d-9708-2e2f6d9d5dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:25.444823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0e749-3b72-421d-9708-2e2f6d9d5dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:25.446325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0e749-3b72-421d-9708-2e2f6d9d5dc5 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:25.456855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1192/2413] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:25.573797 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be232-5d0e-47ac-9dae-6f893140e690 None None] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:25.574090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be232-5d0e-47ac-9dae-6f893140e690 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:25.574363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be232-5d0e-47ac-9dae-6f893140e690 None None] PATH_INFO: `/` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:25.575962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1222/2414] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:33:25.582175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61dd66-6416-498b-9b18-eae309bb18b1 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:25.582801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61dd66-6416-498b-9b18-eae309bb18b1 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:25.582801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61dd66-6416-498b-9b18-eae309bb18b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:25.603309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-cf61dd66-6416-498b-9b18-eae309bb18b1 None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:25.604745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-cf61dd66-6416-498b-9b18-eae309bb18b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:25.616607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1193/2415] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:33:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:33:25.642948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716be232-5d0e-47ac-9dae-6f893140e690 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:25.655522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716be232-5d0e-47ac-9dae-6f893140e690 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:25.659549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca12ad2-6d3c-4acb-9b10-63376998acff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:25.660161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca12ad2-6d3c-4acb-9b10-63376998acff service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:25.660476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca12ad2-6d3c-4acb-9b10-63376998acff service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:25.660987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca12ad2-6d3c-4acb-9b10-63376998acff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:25.672122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca12ad2-6d3c-4acb-9b10-63376998acff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:25.673607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca12ad2-6d3c-4acb-9b10-63376998acff service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:25.685379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1223/2416] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:25.769845 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61dd66-6416-498b-9b18-eae309bb18b1 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:25.772196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-cf61dd66-6416-498b-9b18-eae309bb18b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:25.845054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61dd66-6416-498b-9b18-eae309bb18b1 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:25.851408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25853bcf-25ba-4d4d-a5bb-69fa0b2bd18e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:25.852020 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853bcf-25ba-4d4d-a5bb-69fa0b2bd18e service placement] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:25.852306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853bcf-25ba-4d4d-a5bb-69fa0b2bd18e service placement] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:25.852614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853bcf-25ba-4d4d-a5bb-69fa0b2bd18e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:25.854609 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-25853bcf-25ba-4d4d-a5bb-69fa0b2bd18e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:25.866690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25853bcf-25ba-4d4d-a5bb-69fa0b2bd18e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:25.868291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25853bcf-25ba-4d4d-a5bb-69fa0b2bd18e service placement] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:25.878758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1194/2417] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:26.693385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca12ad2-6d3c-4acb-9b10-63376998acff service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:26.705518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca12ad2-6d3c-4acb-9b10-63376998acff service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:26.712532 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1238d-1b4c-45e0-8109-7512d62887c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:26.713458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1238d-1b4c-45e0-8109-7512d62887c2 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:26.713740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1238d-1b4c-45e0-8109-7512d62887c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:26.714035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1238d-1b4c-45e0-8109-7512d62887c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:26.715887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b9c1238d-1b4c-45e0-8109-7512d62887c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:26.728769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1238d-1b4c-45e0-8109-7512d62887c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:26.730400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1238d-1b4c-45e0-8109-7512d62887c2 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:26.741871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1224/2418] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:35.698896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105861b-518f-4fab-b9e0-fe976d233eaa None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:35.699401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105861b-518f-4fab-b9e0-fe976d233eaa None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:35.699401 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105861b-518f-4fab-b9e0-fe976d233eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:35.720416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-d105861b-518f-4fab-b9e0-fe976d233eaa None None] MFA Rules not processed for user `92f0c702f8ce49a99a10175b0ce68685`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:35.721631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d105861b-518f-4fab-b9e0-fe976d233eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:35.729739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1195/2419] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:36.736583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=27 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:45.714135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=50 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:04.569640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1238d-1b4c-45e0-8109-7512d62887c2 service nova] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:04.579905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1238d-1b4c-45e0-8109-7512d62887c2 service nova] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:04.584576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e0ad-9818-4ea4-82b8-7e4988247a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:04.585174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e0ad-9818-4ea4-82b8-7e4988247a13 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:04.585447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e0ad-9818-4ea4-82b8-7e4988247a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:04.585731 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e0ad-9818-4ea4-82b8-7e4988247a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:04.587863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3514e0ad-9818-4ea4-82b8-7e4988247a13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:04.653848 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e0ad-9818-4ea4-82b8-7e4988247a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:04.655287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e0ad-9818-4ea4-82b8-7e4988247a13 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:04.665867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1225/2420] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:08.123586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105861b-518f-4fab-b9e0-fe976d233eaa None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:08.125381 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d105861b-518f-4fab-b9e0-fe976d233eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:08.140522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105861b-518f-4fab-b9e0-fe976d233eaa None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:08.146270 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12548978-fc0f-46c0-881a-70b2e600e5c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:08.146886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12548978-fc0f-46c0-881a-70b2e600e5c7 service placement] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:08.147156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12548978-fc0f-46c0-881a-70b2e600e5c7 service placement] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:08.147420 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12548978-fc0f-46c0-881a-70b2e600e5c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:08.149326 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-12548978-fc0f-46c0-881a-70b2e600e5c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:08.162167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12548978-fc0f-46c0-881a-70b2e600e5c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:08.163764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12548978-fc0f-46c0-881a-70b2e600e5c7 service placement] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:08.176495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1196/2421] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:08.192979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e0ad-9818-4ea4-82b8-7e4988247a13 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:08.194630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3514e0ad-9818-4ea4-82b8-7e4988247a13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:08.210660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e0ad-9818-4ea4-82b8-7e4988247a13 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:08.215662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:08.216320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:08.216734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:08.217029 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] PATH_INFO: `/v3/users/e4681e0753e84aea8d453465a424e2e3` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:08.218174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4681e0753e84aea8d453465a424e2e3)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:08.224841 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:08.274540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4681e0753e84aea8d453465a424e2e3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:08.275186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4681e0753e84aea8d453465a424e2e3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:08.275780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4681e0753e84aea8d453465a424e2e3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:08.283203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4681e0753e84aea8d453465a424e2e3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:08.296762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-412182ca-3425-4a98-b40d-dff8b53f8d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4681e0753e84aea8d453465a424e2e3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:08.318015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1226/2422] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:34:08 2022] DELETE /identity/v3/users/e4681e0753e84aea8d453465a424e2e3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:34:08.510015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12548978-fc0f-46c0-881a-70b2e600e5c7 service placement] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:08.522737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12548978-fc0f-46c0-881a-70b2e600e5c7 service placement] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:08.583463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:08.584098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:08.584376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:08.584674 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] PATH_INFO: `/v3/projects/804d63e1308b4729aff976d65f667e28` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:08.585787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=804d63e1308b4729aff976d65f667e28)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:08.587714 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:08.643294 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804d63e1308b4729aff976d65f667e28', 'request_id': 'req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:08.649963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804d63e1308b4729aff976d65f667e28', 'request_id': 'req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:08.659745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804d63e1308b4729aff976d65f667e28', 'request_id': 'req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:08.671054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] The token cache is being invalidate because project 804d63e1308b4729aff976d65f667e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:34:08.671341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:08.672045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6ef0c97-a80b-49b1-9c47-84c8404f1be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:08.673610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1197/2423] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:34:08 2022] DELETE /identity/v3/projects/804d63e1308b4729aff976d65f667e28 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:34:08.678908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd7491-3ae8-4888-95c1-ce3f8fbe5b76 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:08.679228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd7491-3ae8-4888-95c1-ce3f8fbe5b76 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:08.679505 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd7491-3ae8-4888-95c1-ce3f8fbe5b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:08.701669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-04cd7491-3ae8-4888-95c1-ce3f8fbe5b76 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:08.702966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-04cd7491-3ae8-4888-95c1-ce3f8fbe5b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:08.764229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1227/2424] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:08.774425 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf44c41-f076-451c-82d7-4cb0bc850f4f None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:08.774767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf44c41-f076-451c-82d7-4cb0bc850f4f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:08.775132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf44c41-f076-451c-82d7-4cb0bc850f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:08.797527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-bbf44c41-f076-451c-82d7-4cb0bc850f4f None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:08.798725 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-bbf44c41-f076-451c-82d7-4cb0bc850f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:08.807139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1198/2425] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:08.813379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd7491-3ae8-4888-95c1-ce3f8fbe5b76 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:08.828965 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd7491-3ae8-4888-95c1-ce3f8fbe5b76 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:08.838057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14752f3-e48e-463f-aaa4-7f6f04f42c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:08.838899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14752f3-e48e-463f-aaa4-7f6f04f42c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:08.839269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14752f3-e48e-463f-aaa4-7f6f04f42c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:08.839629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14752f3-e48e-463f-aaa4-7f6f04f42c4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:08.840623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14752f3-e48e-463f-aaa4-7f6f04f42c4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:34:08.841010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14752f3-e48e-463f-aaa4-7f6f04f42c4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:08.842627 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14752f3-e48e-463f-aaa4-7f6f04f42c4e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:08.844084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:08.855780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1228/2426] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:34:08.861531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf44c41-f076-451c-82d7-4cb0bc850f4f None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:08.874646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf44c41-f076-451c-82d7-4cb0bc850f4f None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:08.879975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2fa8f-7a61-4813-aaca-651f6fe61c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:08.880604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2fa8f-7a61-4813-aaca-651f6fe61c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:08.880879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2fa8f-7a61-4813-aaca-651f6fe61c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:08.881144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2fa8f-7a61-4813-aaca-651f6fe61c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:08.881755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2fa8f-7a61-4813-aaca-651f6fe61c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:08.883669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2fa8f-7a61-4813-aaca-651f6fe61c4f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:08.913879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1199/2427] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:34:08 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:34:08.920090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14752f3-e48e-463f-aaa4-7f6f04f42c4e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:08.932613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14752f3-e48e-463f-aaa4-7f6f04f42c4e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:08.993325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913d11-92e7-4d4d-926c-ebb03fe23644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:08.993924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913d11-92e7-4d4d-926c-ebb03fe23644 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:08.994197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913d11-92e7-4d4d-926c-ebb03fe23644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:08.994470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913d11-92e7-4d4d-926c-ebb03fe23644 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:08.995100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913d11-92e7-4d4d-926c-ebb03fe23644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:08.997166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913d11-92e7-4d4d-926c-ebb03fe23644 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:09.020905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1229/2428] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:34:08 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:34:09.025141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2fa8f-7a61-4813-aaca-651f6fe61c4f admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:09.035646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2fa8f-7a61-4813-aaca-651f6fe61c4f admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:09.040453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eff065-427b-4af7-a371-daa156cc29a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:09.041056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eff065-427b-4af7-a371-daa156cc29a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:09.041333 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eff065-427b-4af7-a371-daa156cc29a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:09.041604 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eff065-427b-4af7-a371-daa156cc29a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:09.042249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eff065-427b-4af7-a371-daa156cc29a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:09.043936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eff065-427b-4af7-a371-daa156cc29a5 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:09.054238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1200/2429] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:34:09.058250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913d11-92e7-4d4d-926c-ebb03fe23644 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:09.068527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913d11-92e7-4d4d-926c-ebb03fe23644 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:09.073622 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d72c1-cbb8-435b-9681-74d797928570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:09.074210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d72c1-cbb8-435b-9681-74d797928570 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:09.074516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d72c1-cbb8-435b-9681-74d797928570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:09.074842 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d72c1-cbb8-435b-9681-74d797928570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:09.075436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d72c1-cbb8-435b-9681-74d797928570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:09.077095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d72c1-cbb8-435b-9681-74d797928570 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:09.087813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1230/2430] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:34:09.092205 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eff065-427b-4af7-a371-daa156cc29a5 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:09.102671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eff065-427b-4af7-a371-daa156cc29a5 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:09.108576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ba76d-a1e4-4b28-b3cf-b4d2a459e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:09.109232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ba76d-a1e4-4b28-b3cf-b4d2a459e493 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:09.109503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ba76d-a1e4-4b28-b3cf-b4d2a459e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:09.109772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ba76d-a1e4-4b28-b3cf-b4d2a459e493 admin admin] PATH_INFO: `/v3/projects/ea12091447ba4a5799d6f416b32fa5cc/users/2d7b54010888421484184e62dd07c258/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:09.125769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ba76d-a1e4-4b28-b3cf-b4d2a459e493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea12091447ba4a5799d6f416b32fa5cc, user_id=2d7b54010888421484184e62dd07c258, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:09.128483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ba76d-a1e4-4b28-b3cf-b4d2a459e493 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:09.143456 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1201/2431] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:34:09 2022] PUT /identity/v3/projects/ea12091447ba4a5799d6f416b32fa5cc/users/2d7b54010888421484184e62dd07c258/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:09.148714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed4ee-ca68-4823-830f-7bb325ff2ce9 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:09.149006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed4ee-ca68-4823-830f-7bb325ff2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:09.149271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed4ee-ca68-4823-830f-7bb325ff2ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:09.168697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-855ed4ee-ca68-4823-830f-7bb325ff2ce9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:09.169733 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-855ed4ee-ca68-4823-830f-7bb325ff2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:09.232745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1231/2432] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:09.245367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ba76d-a1e4-4b28-b3cf-b4d2a459e493 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:09.248074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-791ba76d-a1e4-4b28-b3cf-b4d2a459e493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:09.264622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:09.312214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ba76d-a1e4-4b28-b3cf-b4d2a459e493 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:09.316835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10368c-8f7d-4928-a412-cf317498addf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:09.317472 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10368c-8f7d-4928-a412-cf317498addf service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:09.317737 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10368c-8f7d-4928-a412-cf317498addf service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:09.318010 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10368c-8f7d-4928-a412-cf317498addf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:09.328695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10368c-8f7d-4928-a412-cf317498addf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:09.330139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10368c-8f7d-4928-a412-cf317498addf service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:09.339527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1202/2433] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:14.716510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f17bc5-9ae5-42ec-9432-592a374f28ca None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:14.716998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f17bc5-9ae5-42ec-9432-592a374f28ca None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:14.717652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f17bc5-9ae5-42ec-9432-592a374f28ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:14.762480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-b3f17bc5-9ae5-42ec-9432-592a374f28ca None None] MFA Rules not processed for user `2d7b54010888421484184e62dd07c258`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:14.764452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b3f17bc5-9ae5-42ec-9432-592a374f28ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:14.837107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1232/2434] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:34:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:14.851830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10368c-8f7d-4928-a412-cf317498addf service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:14.853484 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5d10368c-8f7d-4928-a412-cf317498addf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:14.950254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10368c-8f7d-4928-a412-cf317498addf service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:14.955664 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b2b35-e6d3-4694-8314-ccba95714caf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:14.956281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b2b35-e6d3-4694-8314-ccba95714caf service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:14.956721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b2b35-e6d3-4694-8314-ccba95714caf service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:14.957922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b2b35-e6d3-4694-8314-ccba95714caf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:14.967555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b2b35-e6d3-4694-8314-ccba95714caf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:14.969219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b2b35-e6d3-4694-8314-ccba95714caf service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:14.978483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1203/2435] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:16.794311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14fb9d-d2e6-4a0d-8f0f-e14863128a02 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:16.795232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14fb9d-d2e6-4a0d-8f0f-e14863128a02 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:16.795670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14fb9d-d2e6-4a0d-8f0f-e14863128a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:16.804086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:16.827481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ae14fb9d-d2e6-4a0d-8f0f-e14863128a02 None None] MFA Rules not processed for user `2d7b54010888421484184e62dd07c258`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:16.829087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ae14fb9d-d2e6-4a0d-8f0f-e14863128a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:16.843963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1233/2436] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:34:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:17.340808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b2b35-e6d3-4694-8314-ccba95714caf service nova] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:17.342454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-630b2b35-e6d3-4694-8314-ccba95714caf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:17.365483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b2b35-e6d3-4694-8314-ccba95714caf service nova] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:17.370508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca615dc-5c61-4a9e-915f-d1cc3adb8ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:17.371400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca615dc-5c61-4a9e-915f-d1cc3adb8ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:17.371913 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca615dc-5c61-4a9e-915f-d1cc3adb8ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:17.372250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca615dc-5c61-4a9e-915f-d1cc3adb8ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:17.374429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-eca615dc-5c61-4a9e-915f-d1cc3adb8ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:17.388034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca615dc-5c61-4a9e-915f-d1cc3adb8ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:17.389915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca615dc-5c61-4a9e-915f-d1cc3adb8ef8 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:17.398940 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1204/2437] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:17.511299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892510f-8de2-45e8-bd03-2da7e184e7d9 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:17.511616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892510f-8de2-45e8-bd03-2da7e184e7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:17.511894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892510f-8de2-45e8-bd03-2da7e184e7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:17.532697 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-e892510f-8de2-45e8-bd03-2da7e184e7d9 None None] MFA Rules not processed for user `74d0de83f0e54dc8a3c85f2cbda50349`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:17.533917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e892510f-8de2-45e8-bd03-2da7e184e7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:17.606718 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1234/2438] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:34:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:27.395376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=60 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:27.593154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=27 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:22.350611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca615dc-5c61-4a9e-915f-d1cc3adb8ef8 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:22.388320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca615dc-5c61-4a9e-915f-d1cc3adb8ef8 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:22.392338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6c8de-19d8-4755-af73-3558415d6dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:22.393000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6c8de-19d8-4755-af73-3558415d6dff service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:22.393280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6c8de-19d8-4755-af73-3558415d6dff service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:22.393554 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6c8de-19d8-4755-af73-3558415d6dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:22.395361 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-69c6c8de-19d8-4755-af73-3558415d6dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:22.482052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6c8de-19d8-4755-af73-3558415d6dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:22.483494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6c8de-19d8-4755-af73-3558415d6dff service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:22.493109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1205/2439] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:35:23.266942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892510f-8de2-45e8-bd03-2da7e184e7d9 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:23.268586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e892510f-8de2-45e8-bd03-2da7e184e7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:23.454267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892510f-8de2-45e8-bd03-2da7e184e7d9 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:23.459331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baaa560-6cd8-4022-b22e-3cc617b77c30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:23.460025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaa560-6cd8-4022-b22e-3cc617b77c30 service placement] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:23.460305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaa560-6cd8-4022-b22e-3cc617b77c30 service placement] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:23.460606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaa560-6cd8-4022-b22e-3cc617b77c30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:23.462356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2baaa560-6cd8-4022-b22e-3cc617b77c30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:23.474306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baaa560-6cd8-4022-b22e-3cc617b77c30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:23.476094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baaa560-6cd8-4022-b22e-3cc617b77c30 service placement] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:23.487879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1235/2440] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:35:27.667323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b37a5-5c88-47d5-b370-c7bd63a5427a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:27.667879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b37a5-5c88-47d5-b370-c7bd63a5427a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:27.667879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b37a5-5c88-47d5-b370-c7bd63a5427a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:27.687676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-5d3b37a5-5c88-47d5-b370-c7bd63a5427a None None] MFA Rules not processed for user `92f0c702f8ce49a99a10175b0ce68685`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:27.688930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5d3b37a5-5c88-47d5-b370-c7bd63a5427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:27.754901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1206/2441] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:35:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:27.793606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baaa560-6cd8-4022-b22e-3cc617b77c30 service placement] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:27.804071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baaa560-6cd8-4022-b22e-3cc617b77c30 service placement] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:27.809247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeffbc-48a9-4289-a6b4-61558dbdbe10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:27.810140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeffbc-48a9-4289-a6b4-61558dbdbe10 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:27.810703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeffbc-48a9-4289-a6b4-61558dbdbe10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:27.811120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeffbc-48a9-4289-a6b4-61558dbdbe10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:27.813999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-88aeffbc-48a9-4289-a6b4-61558dbdbe10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:27.854267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeffbc-48a9-4289-a6b4-61558dbdbe10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:27.856133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeffbc-48a9-4289-a6b4-61558dbdbe10 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:27.876411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1236/2442] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:35:35.357919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b37a5-5c88-47d5-b370-c7bd63a5427a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:35.359419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5d3b37a5-5c88-47d5-b370-c7bd63a5427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:35.374968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b37a5-5c88-47d5-b370-c7bd63a5427a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:35.379767 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f184205-6489-4108-9305-fb75f09b1231 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:35.380814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f184205-6489-4108-9305-fb75f09b1231 service placement] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:35.381129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f184205-6489-4108-9305-fb75f09b1231 service placement] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:35.381413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f184205-6489-4108-9305-fb75f09b1231 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:35.383085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4f184205-6489-4108-9305-fb75f09b1231 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:35.395486 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f184205-6489-4108-9305-fb75f09b1231 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:35.397239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f184205-6489-4108-9305-fb75f09b1231 service placement] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:35.408408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1207/2443] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:35:35.443861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeffbc-48a9-4289-a6b4-61558dbdbe10 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:35.445476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-88aeffbc-48a9-4289-a6b4-61558dbdbe10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:35.458536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeffbc-48a9-4289-a6b4-61558dbdbe10 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:35.463160 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:35.463793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:35.464072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:35.464345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] PATH_INFO: `/v3/users/7198bde056f148778f52346c3ecedfe5` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:35.465509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7198bde056f148778f52346c3ecedfe5)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:35.467460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:35.525072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7198bde056f148778f52346c3ecedfe5'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:35.526147 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7198bde056f148778f52346c3ecedfe5'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:35.527206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7198bde056f148778f52346c3ecedfe5'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:35.530137 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:35.537272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7198bde056f148778f52346c3ecedfe5'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:35.549422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7198bde056f148778f52346c3ecedfe5'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:35.563396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1237/2444] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:35:35 2022] DELETE /identity/v3/users/7198bde056f148778f52346c3ecedfe5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:35:35.758506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f184205-6489-4108-9305-fb75f09b1231 service placement] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:35.772944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f184205-6489-4108-9305-fb75f09b1231 service placement] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:35.822783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:35.840939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:35.841588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:35.841865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:35.842139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] PATH_INFO: `/v3/projects/d7fc1dae09f145afab37db3a792430d3` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:35.843267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7fc1dae09f145afab37db3a792430d3)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:35.845251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:35.895360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7fc1dae09f145afab37db3a792430d3', 'request_id': 'req-b4ba5676-29fe-41bb-9f18-181f2ad53a25'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:35.902779 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7fc1dae09f145afab37db3a792430d3', 'request_id': 'req-b4ba5676-29fe-41bb-9f18-181f2ad53a25'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:35.912190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7fc1dae09f145afab37db3a792430d3', 'request_id': 'req-b4ba5676-29fe-41bb-9f18-181f2ad53a25'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:35.922288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] The token cache is being invalidate because project d7fc1dae09f145afab37db3a792430d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:35:35.922571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:35.923187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:35.924786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1208/2445] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:35:35 2022] DELETE /identity/v3/projects/d7fc1dae09f145afab37db3a792430d3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:35:35.929576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:35.932153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:35.949288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577792a4-5ead-44c0-8dcb-34cec6112543 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:36.007447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:36.008088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.008365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.008672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] PATH_INFO: `/v3/users/3f8d5bd68288484b92e6c5957b9a9ae2` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:36.009835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8d5bd68288484b92e6c5957b9a9ae2)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:36.011788 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:36.068956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8d5bd68288484b92e6c5957b9a9ae2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:36.069625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8d5bd68288484b92e6c5957b9a9ae2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:36.070242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8d5bd68288484b92e6c5957b9a9ae2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:36.078222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8d5bd68288484b92e6c5957b9a9ae2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:36.091819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-8d7084aa-40ec-42b3-bc76-6bc1077fc0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8d5bd68288484b92e6c5957b9a9ae2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:36.108125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1238/2446] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:35:35 2022] DELETE /identity/v3/users/3f8d5bd68288484b92e6c5957b9a9ae2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:35:36.281563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:36.282960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:36.300844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba5676-29fe-41bb-9f18-181f2ad53a25 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:36.373069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:36.373836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.373941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.374224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] PATH_INFO: `/v3/projects/59d9839473a447c8b12e3f62702ba189` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:36.375383 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d9839473a447c8b12e3f62702ba189)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:36.377340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:36.427377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d9839473a447c8b12e3f62702ba189', 'request_id': 'req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:36.435481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d9839473a447c8b12e3f62702ba189', 'request_id': 'req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:36.445085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d9839473a447c8b12e3f62702ba189', 'request_id': 'req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:36.459313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] The token cache is being invalidate because project 59d9839473a447c8b12e3f62702ba189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:35:36.459539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:36.460178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-00913ba9-2db1-427c-8d42-a4dd0f6f59c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:36.461790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1209/2447] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:35:36 2022] DELETE /identity/v3/projects/59d9839473a447c8b12e3f62702ba189 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:35:36.466844 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0d66-0d44-4d45-b1c9-04d40a4b46a5 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.467311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0d66-0d44-4d45-b1c9-04d40a4b46a5 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.467424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0d66-0d44-4d45-b1c9-04d40a4b46a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:36.528922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-eaec0d66-0d44-4d45-b1c9-04d40a4b46a5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:36.530448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-eaec0d66-0d44-4d45-b1c9-04d40a4b46a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:36.547276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:36.603055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1239/2448] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:36.611470 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a0f5d-3e6a-45c0-b074-f502ad1e013a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.611755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a0f5d-3e6a-45c0-b074-f502ad1e013a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.612024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a0f5d-3e6a-45c0-b074-f502ad1e013a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:36.621589 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:36.635988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4f2a0f5d-3e6a-45c0-b074-f502ad1e013a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:36.637235 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4f2a0f5d-3e6a-45c0-b074-f502ad1e013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:36.645369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1210/2449] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:36.650177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec0d66-0d44-4d45-b1c9-04d40a4b46a5 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:36.660640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec0d66-0d44-4d45-b1c9-04d40a4b46a5 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:36.666803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fec34-369b-4b40-9f58-fda3a3028278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:36.667412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fec34-369b-4b40-9f58-fda3a3028278 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.667692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fec34-369b-4b40-9f58-fda3a3028278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.667964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fec34-369b-4b40-9f58-fda3a3028278 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:36.668660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fec34-369b-4b40-9f58-fda3a3028278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:35:36.668972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fec34-369b-4b40-9f58-fda3a3028278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:36.670602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fec34-369b-4b40-9f58-fda3a3028278 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:36.683194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1240/2450] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:35:36.687809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a0f5d-3e6a-45c0-b074-f502ad1e013a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:36.697319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a0f5d-3e6a-45c0-b074-f502ad1e013a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:36.703596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8b64d-ca89-431a-a1da-d8d4a24acc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:36.704187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8b64d-ca89-431a-a1da-d8d4a24acc9d admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.704500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8b64d-ca89-431a-a1da-d8d4a24acc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.704761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8b64d-ca89-431a-a1da-d8d4a24acc9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:36.705398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8b64d-ca89-431a-a1da-d8d4a24acc9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:36.707309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8b64d-ca89-431a-a1da-d8d4a24acc9d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:36.744193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1211/2451] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:35:36 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:35:36.748424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fec34-369b-4b40-9f58-fda3a3028278 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:36.759195 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fec34-369b-4b40-9f58-fda3a3028278 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:36.820531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcd795-a9f6-49af-b58a-fe7808c5d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:36.821147 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcd795-a9f6-49af-b58a-fe7808c5d3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.821427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcd795-a9f6-49af-b58a-fe7808c5d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.821700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcd795-a9f6-49af-b58a-fe7808c5d3d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:36.822338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcd795-a9f6-49af-b58a-fe7808c5d3d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:36.824299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcd795-a9f6-49af-b58a-fe7808c5d3d4 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:36.848871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1241/2452] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:35:36 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:35:36.853181 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8b64d-ca89-431a-a1da-d8d4a24acc9d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:36.864002 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8b64d-ca89-431a-a1da-d8d4a24acc9d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:36.870380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795909d-e696-4bd4-b746-0aecaf94ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:36.870979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795909d-e696-4bd4-b746-0aecaf94ae49 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.871254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795909d-e696-4bd4-b746-0aecaf94ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.871521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795909d-e696-4bd4-b746-0aecaf94ae49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:36.872163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795909d-e696-4bd4-b746-0aecaf94ae49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:36.873834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795909d-e696-4bd4-b746-0aecaf94ae49 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:36.884728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1212/2453] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:35:36.888993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcd795-a9f6-49af-b58a-fe7808c5d3d4 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:36.899882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcd795-a9f6-49af-b58a-fe7808c5d3d4 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:36.904941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abb133-8c74-46f8-b669-5776ebdb8b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:36.905537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abb133-8c74-46f8-b669-5776ebdb8b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.905838 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abb133-8c74-46f8-b669-5776ebdb8b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.906118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abb133-8c74-46f8-b669-5776ebdb8b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:36.906757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abb133-8c74-46f8-b669-5776ebdb8b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:36.908363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abb133-8c74-46f8-b669-5776ebdb8b75 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:36.919490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1242/2454] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:35:36.924188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795909d-e696-4bd4-b746-0aecaf94ae49 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:36.935403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795909d-e696-4bd4-b746-0aecaf94ae49 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:36.940646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b74aa-66ef-4d21-836f-b97e74649120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:36.941426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b74aa-66ef-4d21-836f-b97e74649120 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.941809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b74aa-66ef-4d21-836f-b97e74649120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.942092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b74aa-66ef-4d21-836f-b97e74649120 admin admin] PATH_INFO: `/v3/projects/9b9158de13684627b042d2a183330eff/users/5c941c1962194ec79b18a0eaf98dc893/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:36.958099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b74aa-66ef-4d21-836f-b97e74649120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9158de13684627b042d2a183330eff, user_id=5c941c1962194ec79b18a0eaf98dc893, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:36.961429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b74aa-66ef-4d21-836f-b97e74649120 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:36.976406 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1213/2455] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:35:36 2022] PUT /identity/v3/projects/9b9158de13684627b042d2a183330eff/users/5c941c1962194ec79b18a0eaf98dc893/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:35:36.982142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0e516-5eb9-4cf8-aa09-339d8bbd5681 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:36.982504 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0e516-5eb9-4cf8-aa09-339d8bbd5681 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:36.982775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0e516-5eb9-4cf8-aa09-339d8bbd5681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:37.001764 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f0f0e516-5eb9-4cf8-aa09-339d8bbd5681 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:37.002887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f0f0e516-5eb9-4cf8-aa09-339d8bbd5681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:37.069836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1243/2456] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:37.080355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b74aa-66ef-4d21-836f-b97e74649120 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:37.082366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3c6b74aa-66ef-4d21-836f-b97e74649120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:37.152781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b74aa-66ef-4d21-836f-b97e74649120 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:37.156757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba732e-9dc0-49c1-b30e-16dae3441ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:37.157366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba732e-9dc0-49c1-b30e-16dae3441ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:37.157623 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba732e-9dc0-49c1-b30e-16dae3441ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:37.157891 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba732e-9dc0-49c1-b30e-16dae3441ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:37.167367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba732e-9dc0-49c1-b30e-16dae3441ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:37.168848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba732e-9dc0-49c1-b30e-16dae3441ed0 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:37.179350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1214/2457] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:35:41.309635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75b710-dbcb-4e85-8067-24becafb8664 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:41.310144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75b710-dbcb-4e85-8067-24becafb8664 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:41.310274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75b710-dbcb-4e85-8067-24becafb8664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:41.339207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3f75b710-dbcb-4e85-8067-24becafb8664 None None] MFA Rules not processed for user `5c941c1962194ec79b18a0eaf98dc893`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:41.340369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3f75b710-dbcb-4e85-8067-24becafb8664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:41.351286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:41.414507 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1244/2458] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:35:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:41.419164 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba732e-9dc0-49c1-b30e-16dae3441ed0 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:41.429220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba732e-9dc0-49c1-b30e-16dae3441ed0 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:41.435207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1b7b-3c19-4b0d-9de3-8d5bbc50e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:41.435967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1b7b-3c19-4b0d-9de3-8d5bbc50e26c admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:41.436309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1b7b-3c19-4b0d-9de3-8d5bbc50e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:41.436678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1b7b-3c19-4b0d-9de3-8d5bbc50e26c admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:41.437371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e1b7b-3c19-4b0d-9de3-8d5bbc50e26c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:41.439291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e1b7b-3c19-4b0d-9de3-8d5bbc50e26c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:41.468968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1215/2459] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:35:41 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:35:41.472728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75b710-dbcb-4e85-8067-24becafb8664 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:41.487620 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75b710-dbcb-4e85-8067-24becafb8664 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:41.557062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60e71-b60b-46a3-bbd8-b3b29872e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:41.557682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60e71-b60b-46a3-bbd8-b3b29872e4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:41.557951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60e71-b60b-46a3-bbd8-b3b29872e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:41.558217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60e71-b60b-46a3-bbd8-b3b29872e4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:41.558853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb60e71-b60b-46a3-bbd8-b3b29872e4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:41.560824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb60e71-b60b-46a3-bbd8-b3b29872e4f5 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:41.585244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1245/2460] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:35:41 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:35:41.589317 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1b7b-3c19-4b0d-9de3-8d5bbc50e26c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:41.599999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1b7b-3c19-4b0d-9de3-8d5bbc50e26c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:41.605497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460da51-b042-4df5-a8aa-e5604280f904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:41.606035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460da51-b042-4df5-a8aa-e5604280f904 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:41.606312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460da51-b042-4df5-a8aa-e5604280f904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:41.606583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460da51-b042-4df5-a8aa-e5604280f904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:41.607224 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460da51-b042-4df5-a8aa-e5604280f904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:41.608875 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460da51-b042-4df5-a8aa-e5604280f904 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:41.620232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1216/2461] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:35:41.624508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60e71-b60b-46a3-bbd8-b3b29872e4f5 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:41.635428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60e71-b60b-46a3-bbd8-b3b29872e4f5 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:41.640726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a28d8-845e-45bb-a6b2-8b9e5da45892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:41.641472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a28d8-845e-45bb-a6b2-8b9e5da45892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:41.641750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a28d8-845e-45bb-a6b2-8b9e5da45892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:41.642020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a28d8-845e-45bb-a6b2-8b9e5da45892 admin admin] PATH_INFO: `/v3/projects/5b0651bb287443c9a01d6476212e25a6/users/cb722c534efa4e87b25f5db03161dfa0/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:41.658210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a28d8-845e-45bb-a6b2-8b9e5da45892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0651bb287443c9a01d6476212e25a6, user_id=cb722c534efa4e87b25f5db03161dfa0, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:41.664424 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a28d8-845e-45bb-a6b2-8b9e5da45892 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:41.691438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1246/2462] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:35:41 2022] PUT /identity/v3/projects/5b0651bb287443c9a01d6476212e25a6/users/cb722c534efa4e87b25f5db03161dfa0/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:35:41.695981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460da51-b042-4df5-a8aa-e5604280f904 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:41.706264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460da51-b042-4df5-a8aa-e5604280f904 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:41.769557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:41.775884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195128b-dcc7-43ce-9477-8329d1824322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:41.776656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195128b-dcc7-43ce-9477-8329d1824322 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:41.777240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195128b-dcc7-43ce-9477-8329d1824322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:41.777729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195128b-dcc7-43ce-9477-8329d1824322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:41.778743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195128b-dcc7-43ce-9477-8329d1824322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:41.780692 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195128b-dcc7-43ce-9477-8329d1824322 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:41.797873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1217/2463] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:35:41.802035 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a28d8-845e-45bb-a6b2-8b9e5da45892 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:41.813752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a28d8-845e-45bb-a6b2-8b9e5da45892 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:41.819121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c0a35-cd4f-4c0f-beac-3b7851ece5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:41.819813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0a35-cd4f-4c0f-beac-3b7851ece5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:41.820093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0a35-cd4f-4c0f-beac-3b7851ece5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:41.820367 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0a35-cd4f-4c0f-beac-3b7851ece5ad admin admin] PATH_INFO: `/v3/projects/5b0651bb287443c9a01d6476212e25a6/users/cb722c534efa4e87b25f5db03161dfa0/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:41.822382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c0a35-cd4f-4c0f-beac-3b7851ece5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0651bb287443c9a01d6476212e25a6, user_id=cb722c534efa4e87b25f5db03161dfa0, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:41.825114 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c0a35-cd4f-4c0f-beac-3b7851ece5ad admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:41.837006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1247/2464] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:35:41 2022] PUT /identity/v3/projects/5b0651bb287443c9a01d6476212e25a6/users/cb722c534efa4e87b25f5db03161dfa0/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:35:46.762322 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888ac54-c689-4897-8c6c-7b3101d7b5de None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:46.763351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888ac54-c689-4897-8c6c-7b3101d7b5de None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:46.763846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888ac54-c689-4897-8c6c-7b3101d7b5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:46.797800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-5888ac54-c689-4897-8c6c-7b3101d7b5de None None] MFA Rules not processed for user `cb722c534efa4e87b25f5db03161dfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:46.798894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5888ac54-c689-4897-8c6c-7b3101d7b5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:46.894296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1218/2465] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:35:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:35:46.909892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c0a35-cd4f-4c0f-beac-3b7851ece5ad admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:46.911901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b82c0a35-cd4f-4c0f-beac-3b7851ece5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:46.984569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:47.027023 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c0a35-cd4f-4c0f-beac-3b7851ece5ad admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:47.034761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ac6a3-5174-494d-a3c0-c519a9d82681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:47.035659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ac6a3-5174-494d-a3c0-c519a9d82681 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:47.036104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ac6a3-5174-494d-a3c0-c519a9d82681 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:47.036406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ac6a3-5174-494d-a3c0-c519a9d82681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:47.106373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ac6a3-5174-494d-a3c0-c519a9d82681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:47.108030 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ac6a3-5174-494d-a3c0-c519a9d82681 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:47.118801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1248/2466] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:35:56.891453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=37 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:57.114544 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=39 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:15.480691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7a82-39fe-4345-9e06-cc4738e56f16 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:15.481312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7a82-39fe-4345-9e06-cc4738e56f16 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:15.481312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7a82-39fe-4345-9e06-cc4738e56f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:15.502567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-945c7a82-39fe-4345-9e06-cc4738e56f16 None None] MFA Rules not processed for user `5c941c1962194ec79b18a0eaf98dc893`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:15.503815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-945c7a82-39fe-4345-9e06-cc4738e56f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:15.511485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1219/2467] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:16.910485 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17759403-1f46-4bb7-8934-e32a239a7ba5 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:16.911122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17759403-1f46-4bb7-8934-e32a239a7ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:16.911122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17759403-1f46-4bb7-8934-e32a239a7ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:16.946782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-17759403-1f46-4bb7-8934-e32a239a7ba5 None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:16.948333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-17759403-1f46-4bb7-8934-e32a239a7ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:17.009026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1249/2468] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:36:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:36:17.058611 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c7a82-39fe-4345-9e06-cc4738e56f16 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:17.061136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-945c7a82-39fe-4345-9e06-cc4738e56f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:17.147520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c7a82-39fe-4345-9e06-cc4738e56f16 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:17.152919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531035b-6d0c-4434-8615-9d7c722712f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:17.153555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531035b-6d0c-4434-8615-9d7c722712f5 service swift] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:17.153823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531035b-6d0c-4434-8615-9d7c722712f5 service swift] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:17.154094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531035b-6d0c-4434-8615-9d7c722712f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:17.163997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531035b-6d0c-4434-8615-9d7c722712f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:17.165465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531035b-6d0c-4434-8615-9d7c722712f5 service swift] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:17.175123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1220/2469] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:36:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:36:24.678054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17759403-1f46-4bb7-8934-e32a239a7ba5 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:24.680294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-17759403-1f46-4bb7-8934-e32a239a7ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:24.757015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17759403-1f46-4bb7-8934-e32a239a7ba5 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:24.760935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c9564-722d-4250-9fef-dc2c3237eeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:24.761555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c9564-722d-4250-9fef-dc2c3237eeff service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:24.766830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c9564-722d-4250-9fef-dc2c3237eeff service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:24.766830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c9564-722d-4250-9fef-dc2c3237eeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:24.766830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c25c9564-722d-4250-9fef-dc2c3237eeff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:24.836539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c9564-722d-4250-9fef-dc2c3237eeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:24.838354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c9564-722d-4250-9fef-dc2c3237eeff service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:24.849353 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1250/2470] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:27.170727 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=35 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:28.682041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531035b-6d0c-4434-8615-9d7c722712f5 service swift] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:28.683887 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6531035b-6d0c-4434-8615-9d7c722712f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:28.699967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531035b-6d0c-4434-8615-9d7c722712f5 service swift] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:28.704720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:28.705437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:28.705871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:28.706282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] PATH_INFO: `/v3/users/74d0de83f0e54dc8a3c85f2cbda50349` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:28.707460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d0de83f0e54dc8a3c85f2cbda50349)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:28.709481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:28.770439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d0de83f0e54dc8a3c85f2cbda50349'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:28.771093 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d0de83f0e54dc8a3c85f2cbda50349'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:28.780021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d0de83f0e54dc8a3c85f2cbda50349'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:28.794106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d0de83f0e54dc8a3c85f2cbda50349'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:28.794849 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-71c44c4c-3a52-44d8-b82c-d5b974774207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d0de83f0e54dc8a3c85f2cbda50349'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:28.810671 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1221/2471] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:36:28 2022] DELETE /identity/v3/users/74d0de83f0e54dc8a3c85f2cbda50349 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:36:28.992469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c9564-722d-4250-9fef-dc2c3237eeff service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:29.003641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c9564-722d-4250-9fef-dc2c3237eeff service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:29.052314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:29.066641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:29.067281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.067560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.067833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] PATH_INFO: `/v3/projects/ea483f6ff12d425fa1e8aa29e472dfe2` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.069004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea483f6ff12d425fa1e8aa29e472dfe2)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:29.071275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:29.122857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea483f6ff12d425fa1e8aa29e472dfe2', 'request_id': 'req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:29.130197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea483f6ff12d425fa1e8aa29e472dfe2', 'request_id': 'req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:29.138290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea483f6ff12d425fa1e8aa29e472dfe2', 'request_id': 'req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:29.156470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] The token cache is being invalidate because project ea483f6ff12d425fa1e8aa29e472dfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:36:29.156835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:29.157476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-cf4e09d6-c4a4-4ab8-8c83-e1959744eb26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:29.159315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1251/2472] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:36:28 2022] DELETE /identity/v3/projects/ea483f6ff12d425fa1e8aa29e472dfe2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:29.164732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f421d5-f98f-4842-9bfd-1b1551d17ab0 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.165086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f421d5-f98f-4842-9bfd-1b1551d17ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.165456 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f421d5-f98f-4842-9bfd-1b1551d17ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.186269 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f7f421d5-f98f-4842-9bfd-1b1551d17ab0 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:29.187481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f7f421d5-f98f-4842-9bfd-1b1551d17ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:29.252534 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1222/2473] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:29.262052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a67170-e3b9-44da-8043-f24eafbd4a60 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.262313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a67170-e3b9-44da-8043-f24eafbd4a60 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.262617 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a67170-e3b9-44da-8043-f24eafbd4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.283181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-25a67170-e3b9-44da-8043-f24eafbd4a60 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:29.284888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-25a67170-e3b9-44da-8043-f24eafbd4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:29.293071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1252/2474] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:29.297620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f421d5-f98f-4842-9bfd-1b1551d17ab0 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:29.308162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f421d5-f98f-4842-9bfd-1b1551d17ab0 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:29.312835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da139f-a0b4-45d9-a7ac-12a29cb4a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:29.313439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da139f-a0b4-45d9-a7ac-12a29cb4a530 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.313718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da139f-a0b4-45d9-a7ac-12a29cb4a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.313991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da139f-a0b4-45d9-a7ac-12a29cb4a530 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.314642 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da139f-a0b4-45d9-a7ac-12a29cb4a530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:36:29.315530 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da139f-a0b4-45d9-a7ac-12a29cb4a530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:29.317033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da139f-a0b4-45d9-a7ac-12a29cb4a530 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:29.330640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1223/2475] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:36:29.336661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a67170-e3b9-44da-8043-f24eafbd4a60 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:29.347693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a67170-e3b9-44da-8043-f24eafbd4a60 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:29.354500 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0cf86-1d26-43d5-8fad-861da3724131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:29.355149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0cf86-1d26-43d5-8fad-861da3724131 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.355450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0cf86-1d26-43d5-8fad-861da3724131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.355717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0cf86-1d26-43d5-8fad-861da3724131 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.356405 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0cf86-1d26-43d5-8fad-861da3724131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:29.358334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0cf86-1d26-43d5-8fad-861da3724131 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:29.392199 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1253/2476] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:36:29 2022] POST /identity/v3/projects => generated 355 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:36:29.393474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da139f-a0b4-45d9-a7ac-12a29cb4a530 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:29.403219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da139f-a0b4-45d9-a7ac-12a29cb4a530 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:29.462656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03cf72-259d-4f11-b3b1-7925c6c3d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:29.463275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03cf72-259d-4f11-b3b1-7925c6c3d4ef admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.463680 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03cf72-259d-4f11-b3b1-7925c6c3d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.463957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03cf72-259d-4f11-b3b1-7925c6c3d4ef admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.464617 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03cf72-259d-4f11-b3b1-7925c6c3d4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:29.466570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03cf72-259d-4f11-b3b1-7925c6c3d4ef admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:29.475043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:29.493295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1224/2477] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:36:29 2022] POST /identity/v3/users => generated 278 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:36:29.497118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0cf86-1d26-43d5-8fad-861da3724131 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:29.508724 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0cf86-1d26-43d5-8fad-861da3724131 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:29.514272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a717df-196d-4313-89f2-d4a4a93d78fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:29.515015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a717df-196d-4313-89f2-d4a4a93d78fd admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.515356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a717df-196d-4313-89f2-d4a4a93d78fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.515691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a717df-196d-4313-89f2-d4a4a93d78fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.516345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a717df-196d-4313-89f2-d4a4a93d78fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:29.518041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a717df-196d-4313-89f2-d4a4a93d78fd admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:29.529127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1254/2478] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:29.532958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03cf72-259d-4f11-b3b1-7925c6c3d4ef admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:29.544411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03cf72-259d-4f11-b3b1-7925c6c3d4ef admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:29.549366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19680900-6302-49e2-af50-930184f061cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:29.550211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19680900-6302-49e2-af50-930184f061cd admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.550375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19680900-6302-49e2-af50-930184f061cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.550537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19680900-6302-49e2-af50-930184f061cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.551180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19680900-6302-49e2-af50-930184f061cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:29.552848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19680900-6302-49e2-af50-930184f061cd admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:29.563981 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1225/2479] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:29.568047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a717df-196d-4313-89f2-d4a4a93d78fd admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:29.578881 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a717df-196d-4313-89f2-d4a4a93d78fd admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:29.583880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d57827-f01b-4de2-b04f-22fce93a4413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:29.584524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d57827-f01b-4de2-b04f-22fce93a4413 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.584825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d57827-f01b-4de2-b04f-22fce93a4413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.585096 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d57827-f01b-4de2-b04f-22fce93a4413 admin admin] PATH_INFO: `/v3/projects/5cdfb6dceb984cdeafe57d7cbeac5820/users/85269da61d5c4665a49ef89bd19a2cfd/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.600076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d57827-f01b-4de2-b04f-22fce93a4413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdfb6dceb984cdeafe57d7cbeac5820, user_id=85269da61d5c4665a49ef89bd19a2cfd, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:29.603271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d57827-f01b-4de2-b04f-22fce93a4413 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:29.621779 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1255/2480] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:36:29 2022] PUT /identity/v3/projects/5cdfb6dceb984cdeafe57d7cbeac5820/users/85269da61d5c4665a49ef89bd19a2cfd/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:29.635558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c569-0e2e-4eeb-b552-fedbf1c587d0 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.635845 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c569-0e2e-4eeb-b552-fedbf1c587d0 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.636116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c569-0e2e-4eeb-b552-fedbf1c587d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.668209 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f823c569-0e2e-4eeb-b552-fedbf1c587d0 None None] MFA Rules not processed for user `85269da61d5c4665a49ef89bd19a2cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:29.669483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f823c569-0e2e-4eeb-b552-fedbf1c587d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:29.750291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1226/2481] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:29.754811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d57827-f01b-4de2-b04f-22fce93a4413 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:29.828586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d57827-f01b-4de2-b04f-22fce93a4413 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:29.839266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c5b39-f9a7-40ec-9d2d-81f4c24d3604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:29.840068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c5b39-f9a7-40ec-9d2d-81f4c24d3604 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.840450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c5b39-f9a7-40ec-9d2d-81f4c24d3604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.840787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c5b39-f9a7-40ec-9d2d-81f4c24d3604 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.841524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c5b39-f9a7-40ec-9d2d-81f4c24d3604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:29.843554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c5b39-f9a7-40ec-9d2d-81f4c24d3604 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:29.869296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:29.878425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1256/2482] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:36:29 2022] POST /identity/v3/projects => generated 355 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:36:29.882893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823c569-0e2e-4eeb-b552-fedbf1c587d0 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:29.894864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823c569-0e2e-4eeb-b552-fedbf1c587d0 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:29.953789 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc999d-a3f7-4d6f-8248-13c24e5b8fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:29.954395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc999d-a3f7-4d6f-8248-13c24e5b8fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:29.954668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc999d-a3f7-4d6f-8248-13c24e5b8fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:29.954934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc999d-a3f7-4d6f-8248-13c24e5b8fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:29.956118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc999d-a3f7-4d6f-8248-13c24e5b8fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:29.958197 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc999d-a3f7-4d6f-8248-13c24e5b8fa8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:29.984635 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1227/2483] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:36:29 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:36:29.985915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c5b39-f9a7-40ec-9d2d-81f4c24d3604 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:29.997737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c5b39-f9a7-40ec-9d2d-81f4c24d3604 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:30.003010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf86f89-a25d-487a-9566-ce05c83c4b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:30.003628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf86f89-a25d-487a-9566-ce05c83c4b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:30.003905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf86f89-a25d-487a-9566-ce05c83c4b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:30.004180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf86f89-a25d-487a-9566-ce05c83c4b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:30.004880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf86f89-a25d-487a-9566-ce05c83c4b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:30.006491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf86f89-a25d-487a-9566-ce05c83c4b2b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:30.019638 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1257/2484] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:30.023672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc999d-a3f7-4d6f-8248-13c24e5b8fa8 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:30.035562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc999d-a3f7-4d6f-8248-13c24e5b8fa8 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:30.040971 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e0d0-cfd3-4d9a-9e1d-1034548cb253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:30.041643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e0d0-cfd3-4d9a-9e1d-1034548cb253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:30.041954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e0d0-cfd3-4d9a-9e1d-1034548cb253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:30.042282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e0d0-cfd3-4d9a-9e1d-1034548cb253 admin admin] PATH_INFO: `/v3/projects/74c8281445ee4961b7e17ed9288411a8/users/1a9abebba54b4360871f8c4b42917529/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:30.059992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e0d0-cfd3-4d9a-9e1d-1034548cb253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c8281445ee4961b7e17ed9288411a8, user_id=1a9abebba54b4360871f8c4b42917529, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:30.062624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e0d0-cfd3-4d9a-9e1d-1034548cb253 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:30.077679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1228/2485] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:36:30 2022] PUT /identity/v3/projects/74c8281445ee4961b7e17ed9288411a8/users/1a9abebba54b4360871f8c4b42917529/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:36:30.081874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf86f89-a25d-487a-9566-ce05c83c4b2b admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:30.092301 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf86f89-a25d-487a-9566-ce05c83c4b2b admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:30.151295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb0880-1504-4276-936b-0b465c41abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:30.152037 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb0880-1504-4276-936b-0b465c41abfe admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:30.152296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb0880-1504-4276-936b-0b465c41abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:30.152611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb0880-1504-4276-936b-0b465c41abfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:30.153266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb0880-1504-4276-936b-0b465c41abfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:30.154893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb0880-1504-4276-936b-0b465c41abfe admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:30.164995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1258/2486] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:30.169733 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e0d0-cfd3-4d9a-9e1d-1034548cb253 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:30.185185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e0d0-cfd3-4d9a-9e1d-1034548cb253 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:30.192731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20356d1b-0498-47b2-ad87-9b6fd663303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:30.193426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20356d1b-0498-47b2-ad87-9b6fd663303e admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:30.193713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20356d1b-0498-47b2-ad87-9b6fd663303e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:30.193921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20356d1b-0498-47b2-ad87-9b6fd663303e admin admin] PATH_INFO: `/v3/projects/74c8281445ee4961b7e17ed9288411a8/users/1a9abebba54b4360871f8c4b42917529/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:30.196140 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20356d1b-0498-47b2-ad87-9b6fd663303e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c8281445ee4961b7e17ed9288411a8, user_id=1a9abebba54b4360871f8c4b42917529, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:30.198854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20356d1b-0498-47b2-ad87-9b6fd663303e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:30.210040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1229/2487] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:36:30 2022] PUT /identity/v3/projects/74c8281445ee4961b7e17ed9288411a8/users/1a9abebba54b4360871f8c4b42917529/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:36:30.220429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5597e-ae87-41a1-94a9-3919402d9dd7 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:30.220721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5597e-ae87-41a1-94a9-3919402d9dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:30.220996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5597e-ae87-41a1-94a9-3919402d9dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:30.250155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-51c5597e-ae87-41a1-94a9-3919402d9dd7 None None] MFA Rules not processed for user `1a9abebba54b4360871f8c4b42917529`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:30.251389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-51c5597e-ae87-41a1-94a9-3919402d9dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:30.329949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1259/2488] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:30.342974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20356d1b-0498-47b2-ad87-9b6fd663303e admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:30.345370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-20356d1b-0498-47b2-ad87-9b6fd663303e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:30.371645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:30.443279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20356d1b-0498-47b2-ad87-9b6fd663303e admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:30.446889 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02ef13-2093-4abb-a2e6-ac599b31eba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:30.447610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02ef13-2093-4abb-a2e6-ac599b31eba1 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:30.447758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02ef13-2093-4abb-a2e6-ac599b31eba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:30.448048 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02ef13-2093-4abb-a2e6-ac599b31eba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:30.462901 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02ef13-2093-4abb-a2e6-ac599b31eba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:30.464375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02ef13-2093-4abb-a2e6-ac599b31eba1 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:30.474687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1230/2489] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:30.565101 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5597e-ae87-41a1-94a9-3919402d9dd7 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:30.575568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5597e-ae87-41a1-94a9-3919402d9dd7 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:30.579455 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fea7fb-571c-428a-9f58-c92305fadbce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:30.580125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea7fb-571c-428a-9f58-c92305fadbce service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:30.580289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea7fb-571c-428a-9f58-c92305fadbce service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:30.580887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea7fb-571c-428a-9f58-c92305fadbce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:30.640840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fea7fb-571c-428a-9f58-c92305fadbce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:30.642332 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fea7fb-571c-428a-9f58-c92305fadbce service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:30.651986 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1260/2490] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:33.458683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eda6b9-95d9-44ae-be81-37e25587f4d3 None None] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:33.459214 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eda6b9-95d9-44ae-be81-37e25587f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:33.459703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eda6b9-95d9-44ae-be81-37e25587f4d3 None None] PATH_INFO: `/` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:33.461788 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1231/2491] 10.222.0.49 () {54 vars in 921 bytes} [Fri Sep 16 19:36:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:36:33.469181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899e67b-1cf1-464d-80ce-510a8f94f667 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:33.469670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899e67b-1cf1-464d-80ce-510a8f94f667 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:33.470069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899e67b-1cf1-464d-80ce-510a8f94f667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:33.488201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:33.495117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3899e67b-1cf1-464d-80ce-510a8f94f667 None None] MFA Rules not processed for user `f9988b9fef5c4d559b1918ffe040aaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:33.496282 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3899e67b-1cf1-464d-80ce-510a8f94f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:33.588402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1261/2492] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Sep 16 19:36:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:33.597417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eda6b9-95d9-44ae-be81-37e25587f4d3 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:33.599239 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b5eda6b9-95d9-44ae-be81-37e25587f4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:33.667253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eda6b9-95d9-44ae-be81-37e25587f4d3 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:33.670803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261da189-64d6-4c53-8584-9c8ca38b6da1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f83a7e0c14541788c92e3d96b839077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:33.671419 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da189-64d6-4c53-8584-9c8ca38b6da1 service glance] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:33.671704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da189-64d6-4c53-8584-9c8ca38b6da1 service glance] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:33.671977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da189-64d6-4c53-8584-9c8ca38b6da1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:33.683775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261da189-64d6-4c53-8584-9c8ca38b6da1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:33.685267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261da189-64d6-4c53-8584-9c8ca38b6da1 service glance] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:33.696339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1232/2493] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:35.086498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899e67b-1cf1-464d-80ce-510a8f94f667 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:35.088161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3899e67b-1cf1-464d-80ce-510a8f94f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:35.148789 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899e67b-1cf1-464d-80ce-510a8f94f667 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:35.152359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8162-e861-4669-9a8f-e7b74b061cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:35.152997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8162-e861-4669-9a8f-e7b74b061cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:35.153274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8162-e861-4669-9a8f-e7b74b061cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:35.153553 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8162-e861-4669-9a8f-e7b74b061cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:35.155861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3d4a8162-e861-4669-9a8f-e7b74b061cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:35.219155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a8162-e861-4669-9a8f-e7b74b061cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:35.220644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a8162-e861-4669-9a8f-e7b74b061cd4 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:35.231798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1262/2494] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:37.148561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45166dd0-0fbd-4384-b34d-83a6851a2791 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:37.149070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45166dd0-0fbd-4384-b34d-83a6851a2791 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:37.149070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45166dd0-0fbd-4384-b34d-83a6851a2791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:37.169850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-45166dd0-0fbd-4384-b34d-83a6851a2791 None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:37.171137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-45166dd0-0fbd-4384-b34d-83a6851a2791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:37.234143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1233/2495] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:36:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:37.246775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8162-e861-4669-9a8f-e7b74b061cd4 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:37.248411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3d4a8162-e861-4669-9a8f-e7b74b061cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:37.309374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:37.336613 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8162-e861-4669-9a8f-e7b74b061cd4 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:37.341732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0897583-7dbe-4a6c-8781-d6a6858ceb0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:37.342347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0897583-7dbe-4a6c-8781-d6a6858ceb0e service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:37.342622 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0897583-7dbe-4a6c-8781-d6a6858ceb0e service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:37.342894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0897583-7dbe-4a6c-8781-d6a6858ceb0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:37.351766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0897583-7dbe-4a6c-8781-d6a6858ceb0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:37.353402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0897583-7dbe-4a6c-8781-d6a6858ceb0e service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:37.362441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1263/2496] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:36:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:36:46.326371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45166dd0-0fbd-4384-b34d-83a6851a2791 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:46.390945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:46.410713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45166dd0-0fbd-4384-b34d-83a6851a2791 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:46.423628 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:46.424300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:46.424631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:46.424874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] PATH_INFO: `/v3/users/85269da61d5c4665a49ef89bd19a2cfd` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:46.426402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85269da61d5c4665a49ef89bd19a2cfd)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:46.429265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:46.488734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85269da61d5c4665a49ef89bd19a2cfd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:46.489507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85269da61d5c4665a49ef89bd19a2cfd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:46.497221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85269da61d5c4665a49ef89bd19a2cfd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:46.509787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85269da61d5c4665a49ef89bd19a2cfd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:46.510523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85269da61d5c4665a49ef89bd19a2cfd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:46.529450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1234/2497] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:36:46 2022] DELETE /identity/v3/users/85269da61d5c4665a49ef89bd19a2cfd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:46.530911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fa903-3a4e-41cd-8adb-785bea679400 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:46.531425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fa903-3a4e-41cd-8adb-785bea679400 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:46.531537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fa903-3a4e-41cd-8adb-785bea679400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:46.551103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-db5fa903-3a4e-41cd-8adb-785bea679400 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:46.552476 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-db5fa903-3a4e-41cd-8adb-785bea679400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:46.626964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1264/2498] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:36:46.637057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:46.638529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:46.711077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fa110-19c1-413e-9c41-c88222dd2d89 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:46.715725 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951573ce-4fa1-48f1-9439-d5b49f990fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:46.716330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951573ce-4fa1-48f1-9439-d5b49f990fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:46.716635 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951573ce-4fa1-48f1-9439-d5b49f990fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:46.716874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951573ce-4fa1-48f1-9439-d5b49f990fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:46.727073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951573ce-4fa1-48f1-9439-d5b49f990fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:46.728592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951573ce-4fa1-48f1-9439-d5b49f990fd1 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:46.738533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1235/2499] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:47.137503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fa903-3a4e-41cd-8adb-785bea679400 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:47.139084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-db5fa903-3a4e-41cd-8adb-785bea679400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:47.154176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fa903-3a4e-41cd-8adb-785bea679400 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:47.161054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:47.162287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:47.162762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:47.163364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] PATH_INFO: `/v3/projects/5cdfb6dceb984cdeafe57d7cbeac5820` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:47.165126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cdfb6dceb984cdeafe57d7cbeac5820)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:47.167624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:47.216688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cdfb6dceb984cdeafe57d7cbeac5820', 'request_id': 'req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.222990 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cdfb6dceb984cdeafe57d7cbeac5820', 'request_id': 'req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.229180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cdfb6dceb984cdeafe57d7cbeac5820', 'request_id': 'req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.243877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] The token cache is being invalidate because project 5cdfb6dceb984cdeafe57d7cbeac5820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:36:47.244162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.244852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.246338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1265/2500] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:36:47 2022] DELETE /identity/v3/projects/5cdfb6dceb984cdeafe57d7cbeac5820 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:47.250380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951573ce-4fa1-48f1-9439-d5b49f990fd1 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:47.260150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951573ce-4fa1-48f1-9439-d5b49f990fd1 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:47.327241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:47.327958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:47.328137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:47.328416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] PATH_INFO: `/v3/users/1a9abebba54b4360871f8c4b42917529` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:47.329570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9abebba54b4360871f8c4b42917529)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:47.331500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:47.345739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:47.387497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9abebba54b4360871f8c4b42917529'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.388220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9abebba54b4360871f8c4b42917529'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.395523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9abebba54b4360871f8c4b42917529'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.408123 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9abebba54b4360871f8c4b42917529'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.408810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e0693021-1422-495e-8f15-b4f3188b4611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9abebba54b4360871f8c4b42917529'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.427722 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1236/2501] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:36:47 2022] DELETE /identity/v3/users/1a9abebba54b4360871f8c4b42917529 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:47.714901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:47.716481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:47.730410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69b0cb-4b34-40c1-bb7d-bef1e482be97 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:47.793192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:47.793830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:47.794104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:47.794378 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] PATH_INFO: `/v3/projects/74c8281445ee4961b7e17ed9288411a8` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:47.795527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c8281445ee4961b7e17ed9288411a8)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:47.797490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:47.799679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:47.856402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c8281445ee4961b7e17ed9288411a8', 'request_id': 'req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.862729 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c8281445ee4961b7e17ed9288411a8', 'request_id': 'req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.870643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c8281445ee4961b7e17ed9288411a8', 'request_id': 'req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.884743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] The token cache is being invalidate because project 74c8281445ee4961b7e17ed9288411a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:36:47.885031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.885682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-03d3e9ea-175b-4f71-8cf2-7c26c72e8147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:47.887228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1266/2502] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:36:47 2022] DELETE /identity/v3/projects/74c8281445ee4961b7e17ed9288411a8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:36:47.892292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277c39a-3461-44a3-b411-d92540ddc2c7 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:47.892615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277c39a-3461-44a3-b411-d92540ddc2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:47.892890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277c39a-3461-44a3-b411-d92540ddc2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:47.912868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-1277c39a-3461-44a3-b411-d92540ddc2c7 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:47.914074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-1277c39a-3461-44a3-b411-d92540ddc2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:47.977163 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1237/2503] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:47.985081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19eb58-0633-4680-ab89-e555f159c7e6 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:47.985363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19eb58-0633-4680-ab89-e555f159c7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:47.985623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19eb58-0633-4680-ab89-e555f159c7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.005279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5e19eb58-0633-4680-ab89-e555f159c7e6 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:48.006502 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5e19eb58-0633-4680-ab89-e555f159c7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:48.014667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1267/2504] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:48.019129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277c39a-3461-44a3-b411-d92540ddc2c7 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.029281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277c39a-3461-44a3-b411-d92540ddc2c7 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.034539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45ed3e-f600-4a67-b89a-0ebae6ec5f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.035142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45ed3e-f600-4a67-b89a-0ebae6ec5f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.035421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45ed3e-f600-4a67-b89a-0ebae6ec5f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.035693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45ed3e-f600-4a67-b89a-0ebae6ec5f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.036457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45ed3e-f600-4a67-b89a-0ebae6ec5f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:36:48.036943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45ed3e-f600-4a67-b89a-0ebae6ec5f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.038540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45ed3e-f600-4a67-b89a-0ebae6ec5f7f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.050064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1238/2505] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:36:48.054862 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19eb58-0633-4680-ab89-e555f159c7e6 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.064332 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19eb58-0633-4680-ab89-e555f159c7e6 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.070005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b6823-6e9f-4631-8c26-4e9d9e94144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.070607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b6823-6e9f-4631-8c26-4e9d9e94144c admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.070909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b6823-6e9f-4631-8c26-4e9d9e94144c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.071172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b6823-6e9f-4631-8c26-4e9d9e94144c admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.071806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b6823-6e9f-4631-8c26-4e9d9e94144c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.073768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b6823-6e9f-4631-8c26-4e9d9e94144c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.115381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1268/2506] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:36:48 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:36:48.120331 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45ed3e-f600-4a67-b89a-0ebae6ec5f7f admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.131738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45ed3e-f600-4a67-b89a-0ebae6ec5f7f admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.193223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a628fe-1a20-44f2-a3e4-e34c9b80990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.193839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a628fe-1a20-44f2-a3e4-e34c9b80990c admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.194118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a628fe-1a20-44f2-a3e4-e34c9b80990c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.194395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a628fe-1a20-44f2-a3e4-e34c9b80990c admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.195071 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a628fe-1a20-44f2-a3e4-e34c9b80990c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.197083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a628fe-1a20-44f2-a3e4-e34c9b80990c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.224074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1239/2507] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:36:48 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:36:48.226180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b6823-6e9f-4631-8c26-4e9d9e94144c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.237095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b6823-6e9f-4631-8c26-4e9d9e94144c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.242505 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f35e46-9453-4d8c-9091-d3bdc14783cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.243197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f35e46-9453-4d8c-9091-d3bdc14783cd admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.243561 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f35e46-9453-4d8c-9091-d3bdc14783cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.243897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f35e46-9453-4d8c-9091-d3bdc14783cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.244591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f35e46-9453-4d8c-9091-d3bdc14783cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.246219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f35e46-9453-4d8c-9091-d3bdc14783cd admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.259661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1269/2508] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:48.261040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a628fe-1a20-44f2-a3e4-e34c9b80990c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.272690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a628fe-1a20-44f2-a3e4-e34c9b80990c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.277649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909d87b-7a66-4c68-8e9b-3b3472bd7fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.278353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909d87b-7a66-4c68-8e9b-3b3472bd7fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.278752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909d87b-7a66-4c68-8e9b-3b3472bd7fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.279087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909d87b-7a66-4c68-8e9b-3b3472bd7fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.279826 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909d87b-7a66-4c68-8e9b-3b3472bd7fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.281907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909d87b-7a66-4c68-8e9b-3b3472bd7fb6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.288481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:48.298816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1240/2509] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:48.303142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f35e46-9453-4d8c-9091-d3bdc14783cd admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.313204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f35e46-9453-4d8c-9091-d3bdc14783cd admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.317884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f26395-3f07-4aa6-9a94-cba0ffcda368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.318538 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f26395-3f07-4aa6-9a94-cba0ffcda368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.318817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f26395-3f07-4aa6-9a94-cba0ffcda368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.319091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f26395-3f07-4aa6-9a94-cba0ffcda368 admin admin] PATH_INFO: `/v3/projects/c97701a2126d46939aa53939f3e12289/users/af8970e0de52406f923e17c135d558e2/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.334669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f26395-3f07-4aa6-9a94-cba0ffcda368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97701a2126d46939aa53939f3e12289, user_id=af8970e0de52406f923e17c135d558e2, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.337448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f26395-3f07-4aa6-9a94-cba0ffcda368 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.352871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1270/2510] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:36:48 2022] PUT /identity/v3/projects/c97701a2126d46939aa53939f3e12289/users/af8970e0de52406f923e17c135d558e2/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:36:48.363403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc877cd-6fc6-4833-9ed5-acb28c6db355 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.363953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc877cd-6fc6-4833-9ed5-acb28c6db355 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.363953 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc877cd-6fc6-4833-9ed5-acb28c6db355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.391867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-bbc877cd-6fc6-4833-9ed5-acb28c6db355 None None] MFA Rules not processed for user `af8970e0de52406f923e17c135d558e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:48.393084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-bbc877cd-6fc6-4833-9ed5-acb28c6db355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:48.462343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1241/2511] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:36:48.466906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f26395-3f07-4aa6-9a94-cba0ffcda368 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.532539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f26395-3f07-4aa6-9a94-cba0ffcda368 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.537737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6a4af-8ebb-4fa3-ab04-5fa14ef5178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.538352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a4af-8ebb-4fa3-ab04-5fa14ef5178a admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.538628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a4af-8ebb-4fa3-ab04-5fa14ef5178a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.538926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a4af-8ebb-4fa3-ab04-5fa14ef5178a admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.539591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6a4af-8ebb-4fa3-ab04-5fa14ef5178a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.541739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6a4af-8ebb-4fa3-ab04-5fa14ef5178a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.570891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1271/2512] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:36:48 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:36:48.575236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc877cd-6fc6-4833-9ed5-acb28c6db355 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.586218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc877cd-6fc6-4833-9ed5-acb28c6db355 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.647594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d70c6b-f7a7-4510-b199-66ed4ed806a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.648212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d70c6b-f7a7-4510-b199-66ed4ed806a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.648522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d70c6b-f7a7-4510-b199-66ed4ed806a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.648809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d70c6b-f7a7-4510-b199-66ed4ed806a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.649438 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d70c6b-f7a7-4510-b199-66ed4ed806a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.651369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d70c6b-f7a7-4510-b199-66ed4ed806a8 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.679039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1242/2513] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:36:48 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:36:48.685111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6a4af-8ebb-4fa3-ab04-5fa14ef5178a admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.694915 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:48.699120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6a4af-8ebb-4fa3-ab04-5fa14ef5178a admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.705794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5d7d-a8bf-4760-abec-fe9b008dd8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.706408 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5d7d-a8bf-4760-abec-fe9b008dd8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.706988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5d7d-a8bf-4760-abec-fe9b008dd8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.707283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5d7d-a8bf-4760-abec-fe9b008dd8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.708281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d5d7d-a8bf-4760-abec-fe9b008dd8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.710236 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d5d7d-a8bf-4760-abec-fe9b008dd8f1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.721233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1272/2514] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:48.726261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d70c6b-f7a7-4510-b199-66ed4ed806a8 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.736591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d70c6b-f7a7-4510-b199-66ed4ed806a8 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.741739 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6f5c3-8893-48a7-98bf-aae5321b6ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.742385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6f5c3-8893-48a7-98bf-aae5321b6ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.742673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6f5c3-8893-48a7-98bf-aae5321b6ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.742945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6f5c3-8893-48a7-98bf-aae5321b6ab2 admin admin] PATH_INFO: `/v3/projects/5e83e04b0dcb4fbca51e26286e5d71cd/users/d38b4fdcf07d4fb8be70520ffc57e8ff/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.760018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6f5c3-8893-48a7-98bf-aae5321b6ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e83e04b0dcb4fbca51e26286e5d71cd, user_id=d38b4fdcf07d4fb8be70520ffc57e8ff, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.762830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6f5c3-8893-48a7-98bf-aae5321b6ab2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.778328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1243/2515] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:36:48 2022] PUT /identity/v3/projects/5e83e04b0dcb4fbca51e26286e5d71cd/users/d38b4fdcf07d4fb8be70520ffc57e8ff/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:48.782335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5d7d-a8bf-4760-abec-fe9b008dd8f1 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.792772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5d7d-a8bf-4760-abec-fe9b008dd8f1 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.849820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9488d6-e617-4250-8ff3-4db7208f59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.850420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9488d6-e617-4250-8ff3-4db7208f59d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.850693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9488d6-e617-4250-8ff3-4db7208f59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.850960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9488d6-e617-4250-8ff3-4db7208f59d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.851595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9488d6-e617-4250-8ff3-4db7208f59d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.853623 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9488d6-e617-4250-8ff3-4db7208f59d6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.863464 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1273/2516] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:48.870254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6f5c3-8893-48a7-98bf-aae5321b6ab2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:48.884856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6f5c3-8893-48a7-98bf-aae5321b6ab2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:48.890399 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d756668-8c7c-4a30-94b9-154ebd451791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:48.891045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d756668-8c7c-4a30-94b9-154ebd451791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.891323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d756668-8c7c-4a30-94b9-154ebd451791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.891595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d756668-8c7c-4a30-94b9-154ebd451791 admin admin] PATH_INFO: `/v3/projects/5e83e04b0dcb4fbca51e26286e5d71cd/users/d38b4fdcf07d4fb8be70520ffc57e8ff/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.893810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d756668-8c7c-4a30-94b9-154ebd451791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e83e04b0dcb4fbca51e26286e5d71cd, user_id=d38b4fdcf07d4fb8be70520ffc57e8ff, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:48.896765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d756668-8c7c-4a30-94b9-154ebd451791 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:48.908108 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1244/2517] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:36:48 2022] PUT /identity/v3/projects/5e83e04b0dcb4fbca51e26286e5d71cd/users/d38b4fdcf07d4fb8be70520ffc57e8ff/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:48.920033 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032f8d-e437-432d-9595-c36a0fab4c5c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:48.920343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032f8d-e437-432d-9595-c36a0fab4c5c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:48.920692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032f8d-e437-432d-9595-c36a0fab4c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:48.952019 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0d032f8d-e437-432d-9595-c36a0fab4c5c None None] MFA Rules not processed for user `d38b4fdcf07d4fb8be70520ffc57e8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:48.953269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0d032f8d-e437-432d-9595-c36a0fab4c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:49.033207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1274/2518] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:49.044520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d756668-8c7c-4a30-94b9-154ebd451791 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:49.046686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2d756668-8c7c-4a30-94b9-154ebd451791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:49.091754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:49.107261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d756668-8c7c-4a30-94b9-154ebd451791 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:49.110990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db867c71-7aa1-4282-b3ec-8e0a3680ecb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:49.111588 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867c71-7aa1-4282-b3ec-8e0a3680ecb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:49.111863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867c71-7aa1-4282-b3ec-8e0a3680ecb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:49.112132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867c71-7aa1-4282-b3ec-8e0a3680ecb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:49.121529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db867c71-7aa1-4282-b3ec-8e0a3680ecb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:49.122954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db867c71-7aa1-4282-b3ec-8e0a3680ecb3 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:49.132316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1245/2519] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:50.578732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d032f8d-e437-432d-9595-c36a0fab4c5c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:50.598520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db867c71-7aa1-4282-b3ec-8e0a3680ecb3 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:50.600970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-db867c71-7aa1-4282-b3ec-8e0a3680ecb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:50.651210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d032f8d-e437-432d-9595-c36a0fab4c5c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:50.656768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:50.657411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:50.657693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:50.657963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] PATH_INFO: `/v3/users/af8970e0de52406f923e17c135d558e2` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:50.659117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8970e0de52406f923e17c135d558e2)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:50.661346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:50.667340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db867c71-7aa1-4282-b3ec-8e0a3680ecb3 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:50.670390 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9394d3a-6d47-4d79-96f3-a2674ce2dcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:50.670957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9394d3a-6d47-4d79-96f3-a2674ce2dcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:50.671228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9394d3a-6d47-4d79-96f3-a2674ce2dcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:50.671491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9394d3a-6d47-4d79-96f3-a2674ce2dcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:50.673572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e9394d3a-6d47-4d79-96f3-a2674ce2dcb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:50.679641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:50.712095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8970e0de52406f923e17c135d558e2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:50.712898 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8970e0de52406f923e17c135d558e2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:50.713499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8970e0de52406f923e17c135d558e2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:50.720217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8970e0de52406f923e17c135d558e2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:50.732145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7ed19332-a6f8-49f8-85fe-b549790baffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8970e0de52406f923e17c135d558e2'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:50.745896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1275/2520] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:36:50 2022] DELETE /identity/v3/users/af8970e0de52406f923e17c135d558e2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:50.748185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9394d3a-6d47-4d79-96f3-a2674ce2dcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:50.749805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9394d3a-6d47-4d79-96f3-a2674ce2dcb9 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:50.750320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f82d3-ef52-416f-adfe-f201046f5325 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:50.750606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f82d3-ef52-416f-adfe-f201046f5325 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:50.750903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f82d3-ef52-416f-adfe-f201046f5325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:50.767398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1246/2521] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:50.774793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d16f82d3-ef52-416f-adfe-f201046f5325 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:50.776072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d16f82d3-ef52-416f-adfe-f201046f5325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:50.843565 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1276/2522] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:36:50.853691 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9394d3a-6d47-4d79-96f3-a2674ce2dcb9 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:50.862640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9394d3a-6d47-4d79-96f3-a2674ce2dcb9 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:50.914651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f4a37-8e43-475c-8d56-f6441a30e8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:50.915259 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4a37-8e43-475c-8d56-f6441a30e8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:50.915538 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4a37-8e43-475c-8d56-f6441a30e8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:50.915808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4a37-8e43-475c-8d56-f6441a30e8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:50.925625 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f4a37-8e43-475c-8d56-f6441a30e8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:50.927116 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f4a37-8e43-475c-8d56-f6441a30e8e9 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:50.937306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1247/2523] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:51.561788 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f82d3-ef52-416f-adfe-f201046f5325 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:51.563257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d16f82d3-ef52-416f-adfe-f201046f5325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:51.583247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f82d3-ef52-416f-adfe-f201046f5325 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:51.589356 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:51.589940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:51.590219 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:51.590490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] PATH_INFO: `/v3/projects/c97701a2126d46939aa53939f3e12289` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:51.592866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97701a2126d46939aa53939f3e12289)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:51.595673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:51.648473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97701a2126d46939aa53939f3e12289', 'request_id': 'req-ef585c58-5d55-4b72-bd9e-72187d288435'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:51.654977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97701a2126d46939aa53939f3e12289', 'request_id': 'req-ef585c58-5d55-4b72-bd9e-72187d288435'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:51.661332 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97701a2126d46939aa53939f3e12289', 'request_id': 'req-ef585c58-5d55-4b72-bd9e-72187d288435'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:51.675266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] The token cache is being invalidate because project c97701a2126d46939aa53939f3e12289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:36:51.675604 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:51.676313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:51.677980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1277/2524] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:36:51 2022] DELETE /identity/v3/projects/c97701a2126d46939aa53939f3e12289 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:51.682169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f4a37-8e43-475c-8d56-f6441a30e8e9 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:51.692286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f4a37-8e43-475c-8d56-f6441a30e8e9 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:51.718250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:51.758631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:51.759263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:51.759557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:51.759826 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] PATH_INFO: `/v3/users/d38b4fdcf07d4fb8be70520ffc57e8ff` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:51.760989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38b4fdcf07d4fb8be70520ffc57e8ff)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:51.763407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:51.821210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38b4fdcf07d4fb8be70520ffc57e8ff'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:51.821884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38b4fdcf07d4fb8be70520ffc57e8ff'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:51.835997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38b4fdcf07d4fb8be70520ffc57e8ff'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:51.852217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38b4fdcf07d4fb8be70520ffc57e8ff'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:51.853859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38b4fdcf07d4fb8be70520ffc57e8ff'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:51.872592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1248/2525] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:36:51 2022] DELETE /identity/v3/users/d38b4fdcf07d4fb8be70520ffc57e8ff => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:51.900782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:51.902237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:51.925458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:51.974294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef585c58-5d55-4b72-bd9e-72187d288435 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:52.026568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24c313-203f-4b3e-9153-d35e01389453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:52.027251 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c313-203f-4b3e-9153-d35e01389453 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.027529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c313-203f-4b3e-9153-d35e01389453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.027801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c313-203f-4b3e-9153-d35e01389453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.029632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4c24c313-203f-4b3e-9153-d35e01389453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:52.106571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24c313-203f-4b3e-9153-d35e01389453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:52.108051 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24c313-203f-4b3e-9153-d35e01389453 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:52.119587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1278/2526] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:52.157385 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:52.159006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:52.244003 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fe0d6-7bbd-45ab-a86c-81745da54031 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:52.248553 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:52.249188 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.249463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.249729 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] PATH_INFO: `/v3/projects/5e83e04b0dcb4fbca51e26286e5d71cd` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.250823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e83e04b0dcb4fbca51e26286e5d71cd)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:52.252761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:52.299190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:52.300408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e83e04b0dcb4fbca51e26286e5d71cd', 'request_id': 'req-45835556-bea5-44be-9141-a70ec2d68a09'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:52.307131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e83e04b0dcb4fbca51e26286e5d71cd', 'request_id': 'req-45835556-bea5-44be-9141-a70ec2d68a09'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:52.315865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e83e04b0dcb4fbca51e26286e5d71cd', 'request_id': 'req-45835556-bea5-44be-9141-a70ec2d68a09'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:52.326531 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] The token cache is being invalidate because project 5e83e04b0dcb4fbca51e26286e5d71cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:36:52.326811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:52.327502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-45835556-bea5-44be-9141-a70ec2d68a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:52.329034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1249/2527] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:36:52 2022] DELETE /identity/v3/projects/5e83e04b0dcb4fbca51e26286e5d71cd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:36:52.334275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddbe32-86b8-4839-b951-12ca09dbf5d4 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.334573 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddbe32-86b8-4839-b951-12ca09dbf5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.334854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddbe32-86b8-4839-b951-12ca09dbf5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.483939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-34ddbe32-86b8-4839-b951-12ca09dbf5d4 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:52.485208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-34ddbe32-86b8-4839-b951-12ca09dbf5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:52.561799 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1279/2528] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:36:52.570273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72b42a-46e6-4212-b1c4-0677d15d4e79 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.570561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72b42a-46e6-4212-b1c4-0677d15d4e79 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.570835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72b42a-46e6-4212-b1c4-0677d15d4e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.590741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2e72b42a-46e6-4212-b1c4-0677d15d4e79 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:52.591941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2e72b42a-46e6-4212-b1c4-0677d15d4e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:52.600429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1250/2529] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:52.604695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddbe32-86b8-4839-b951-12ca09dbf5d4 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:52.614791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddbe32-86b8-4839-b951-12ca09dbf5d4 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:52.620625 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7288196-d5c9-4a33-8bfd-0d9ff2d21688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:52.621226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288196-d5c9-4a33-8bfd-0d9ff2d21688 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.621501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288196-d5c9-4a33-8bfd-0d9ff2d21688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.621766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288196-d5c9-4a33-8bfd-0d9ff2d21688 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.622411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7288196-d5c9-4a33-8bfd-0d9ff2d21688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:36:52.622710 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7288196-d5c9-4a33-8bfd-0d9ff2d21688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:52.624303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7288196-d5c9-4a33-8bfd-0d9ff2d21688 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:52.637000 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1280/2530] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:36:52.642281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72b42a-46e6-4212-b1c4-0677d15d4e79 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:52.652026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72b42a-46e6-4212-b1c4-0677d15d4e79 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:52.657311 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b10f2a-766a-48cc-916f-048451d27639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:52.657908 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b10f2a-766a-48cc-916f-048451d27639 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.658186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b10f2a-766a-48cc-916f-048451d27639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.658455 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b10f2a-766a-48cc-916f-048451d27639 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.659097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b10f2a-766a-48cc-916f-048451d27639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:52.661135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b10f2a-766a-48cc-916f-048451d27639 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:52.697758 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1251/2531] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:36:52 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:36:52.698941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7288196-d5c9-4a33-8bfd-0d9ff2d21688 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:52.704258 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:52.710752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7288196-d5c9-4a33-8bfd-0d9ff2d21688 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:52.769743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479efa8a-0150-4242-a6c1-8521c50e5902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:52.770435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479efa8a-0150-4242-a6c1-8521c50e5902 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.770776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479efa8a-0150-4242-a6c1-8521c50e5902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.771031 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479efa8a-0150-4242-a6c1-8521c50e5902 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.771684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479efa8a-0150-4242-a6c1-8521c50e5902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:52.773674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479efa8a-0150-4242-a6c1-8521c50e5902 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:52.799361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1281/2532] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:36:52 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:36:52.804524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b10f2a-766a-48cc-916f-048451d27639 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:52.815157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b10f2a-766a-48cc-916f-048451d27639 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:52.821145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf58c7-c5b9-40d2-b326-0451953dcd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:52.821763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf58c7-c5b9-40d2-b326-0451953dcd37 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.822016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf58c7-c5b9-40d2-b326-0451953dcd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.822278 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf58c7-c5b9-40d2-b326-0451953dcd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.822919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf58c7-c5b9-40d2-b326-0451953dcd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:52.824547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf58c7-c5b9-40d2-b326-0451953dcd37 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:52.835170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1252/2533] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:52.839208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479efa8a-0150-4242-a6c1-8521c50e5902 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:52.849738 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479efa8a-0150-4242-a6c1-8521c50e5902 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:52.854869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702b360-920f-4d4f-9ce9-af33670594cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:52.855451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702b360-920f-4d4f-9ce9-af33670594cc admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.855705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702b360-920f-4d4f-9ce9-af33670594cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.855993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702b360-920f-4d4f-9ce9-af33670594cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.856663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702b360-920f-4d4f-9ce9-af33670594cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:52.858253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702b360-920f-4d4f-9ce9-af33670594cc admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:52.868879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1282/2534] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:52.872914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf58c7-c5b9-40d2-b326-0451953dcd37 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:52.883859 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf58c7-c5b9-40d2-b326-0451953dcd37 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:52.889610 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9d127-4d28-46a7-bc62-2b372542ae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:52.890251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d127-4d28-46a7-bc62-2b372542ae2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.890545 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d127-4d28-46a7-bc62-2b372542ae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.890820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d127-4d28-46a7-bc62-2b372542ae2b admin admin] PATH_INFO: `/v3/projects/78bc0fc2b0b04ab3a79f598ecaa0a3c0/users/d8bfee41920c4221a6355abd325662c1/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.906505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9d127-4d28-46a7-bc62-2b372542ae2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bc0fc2b0b04ab3a79f598ecaa0a3c0, user_id=d8bfee41920c4221a6355abd325662c1, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:52.909271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9d127-4d28-46a7-bc62-2b372542ae2b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:52.924957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1253/2535] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:36:52 2022] PUT /identity/v3/projects/78bc0fc2b0b04ab3a79f598ecaa0a3c0/users/d8bfee41920c4221a6355abd325662c1/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:52.941589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06b74c-1dde-46f5-8969-f33df694926c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:52.941866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06b74c-1dde-46f5-8969-f33df694926c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:52.942138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06b74c-1dde-46f5-8969-f33df694926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:52.971759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-5b06b74c-1dde-46f5-8969-f33df694926c None None] MFA Rules not processed for user `d8bfee41920c4221a6355abd325662c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:52.973073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5b06b74c-1dde-46f5-8969-f33df694926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:53.055978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1283/2536] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:53.070695 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9d127-4d28-46a7-bc62-2b372542ae2b admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:53.072593 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3cb9d127-4d28-46a7-bc62-2b372542ae2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:53.132681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9d127-4d28-46a7-bc62-2b372542ae2b admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:53.136831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b45b-253f-4f47-b918-50f2a6e1f125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:53.137650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b45b-253f-4f47-b918-50f2a6e1f125 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:53.137978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b45b-253f-4f47-b918-50f2a6e1f125 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:53.138350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b45b-253f-4f47-b918-50f2a6e1f125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:53.148186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b45b-253f-4f47-b918-50f2a6e1f125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:53.149697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b45b-253f-4f47-b918-50f2a6e1f125 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:53.159037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1254/2537] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:53.187134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06b74c-1dde-46f5-8969-f33df694926c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:53.251046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06b74c-1dde-46f5-8969-f33df694926c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:53.256189 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:53.256875 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:53.257150 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:53.257400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] PATH_INFO: `/v3/users/d8bfee41920c4221a6355abd325662c1` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:53.258659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8bfee41920c4221a6355abd325662c1)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:53.260620 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:53.276402 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:53.312776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8bfee41920c4221a6355abd325662c1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:53.313366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8bfee41920c4221a6355abd325662c1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:53.313946 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8bfee41920c4221a6355abd325662c1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:53.331630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8bfee41920c4221a6355abd325662c1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:53.345591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8bfee41920c4221a6355abd325662c1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:53.361426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1284/2538] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:36:53 2022] DELETE /identity/v3/users/d8bfee41920c4221a6355abd325662c1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:53.366292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ae1c7-0e4d-40c5-bcc5-114a6d367961 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:53.366292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ae1c7-0e4d-40c5-bcc5-114a6d367961 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:53.366561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ae1c7-0e4d-40c5-bcc5-114a6d367961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:53.386988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-182ae1c7-0e4d-40c5-bcc5-114a6d367961 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:53.388198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-182ae1c7-0e4d-40c5-bcc5-114a6d367961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:53.449522 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1255/2539] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:36:53.459489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:53.461022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:53.523315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8df1b-063d-48a2-9357-eff2d3c18d2e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:53.527523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fa765-0633-45d8-9f77-97af674f642c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:53.528121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fa765-0633-45d8-9f77-97af674f642c service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:53.528417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fa765-0633-45d8-9f77-97af674f642c service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:53.528692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fa765-0633-45d8-9f77-97af674f642c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:53.539865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fa765-0633-45d8-9f77-97af674f642c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:53.541343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fa765-0633-45d8-9f77-97af674f642c service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:53.551611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1285/2540] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:53.822234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ae1c7-0e4d-40c5-bcc5-114a6d367961 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:53.823734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-182ae1c7-0e4d-40c5-bcc5-114a6d367961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:53.836277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ae1c7-0e4d-40c5-bcc5-114a6d367961 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:53.841724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:53.842370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:53.842649 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:53.843277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] PATH_INFO: `/v3/projects/78bc0fc2b0b04ab3a79f598ecaa0a3c0` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:53.844157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=78bc0fc2b0b04ab3a79f598ecaa0a3c0)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:53.846174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:53.858031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:53.896109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78bc0fc2b0b04ab3a79f598ecaa0a3c0', 'request_id': 'req-f6654f6c-7e60-4b54-865f-be98b4601dda'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:53.902615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78bc0fc2b0b04ab3a79f598ecaa0a3c0', 'request_id': 'req-f6654f6c-7e60-4b54-865f-be98b4601dda'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:53.914443 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78bc0fc2b0b04ab3a79f598ecaa0a3c0', 'request_id': 'req-f6654f6c-7e60-4b54-865f-be98b4601dda'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:53.927984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] The token cache is being invalidate because project 78bc0fc2b0b04ab3a79f598ecaa0a3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:36:53.928343 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:53.929203 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f6654f6c-7e60-4b54-865f-be98b4601dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:36:53.930732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1256/2541] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:36:53 2022] DELETE /identity/v3/projects/78bc0fc2b0b04ab3a79f598ecaa0a3c0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:53.935595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566cde8-a2de-4b0e-a4df-f0e1a7fe284e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:53.936052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566cde8-a2de-4b0e-a4df-f0e1a7fe284e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:53.936176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566cde8-a2de-4b0e-a4df-f0e1a7fe284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:53.955526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8566cde8-a2de-4b0e-a4df-f0e1a7fe284e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:53.956759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8566cde8-a2de-4b0e-a4df-f0e1a7fe284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:54.027816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1286/2542] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:54.035658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4615cb-1136-42ea-9057-1114e962814a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:54.035944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4615cb-1136-42ea-9057-1114e962814a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:54.036219 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4615cb-1136-42ea-9057-1114e962814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:54.056978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-fc4615cb-1136-42ea-9057-1114e962814a None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:54.058194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-fc4615cb-1136-42ea-9057-1114e962814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:54.066748 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1257/2543] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:54.071122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566cde8-a2de-4b0e-a4df-f0e1a7fe284e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:54.081448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566cde8-a2de-4b0e-a4df-f0e1a7fe284e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:54.087284 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98f70-bed4-4d67-b57c-2288d341c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:54.087886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98f70-bed4-4d67-b57c-2288d341c9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:54.088135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98f70-bed4-4d67-b57c-2288d341c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:54.088420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98f70-bed4-4d67-b57c-2288d341c9c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:54.089094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98f70-bed4-4d67-b57c-2288d341c9c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:36:54.089389 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98f70-bed4-4d67-b57c-2288d341c9c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:54.091043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98f70-bed4-4d67-b57c-2288d341c9c0 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:54.103727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1287/2544] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:36:54.107910 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4615cb-1136-42ea-9057-1114e962814a None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:54.117600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4615cb-1136-42ea-9057-1114e962814a None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:54.122790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d709fd-4b07-43ee-ac41-2cd81f855a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:54.123391 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d709fd-4b07-43ee-ac41-2cd81f855a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:54.123670 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d709fd-4b07-43ee-ac41-2cd81f855a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:54.123939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d709fd-4b07-43ee-ac41-2cd81f855a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:54.124606 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d709fd-4b07-43ee-ac41-2cd81f855a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:54.126528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d709fd-4b07-43ee-ac41-2cd81f855a4f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:54.156603 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1258/2545] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:36:54 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:36:54.162056 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98f70-bed4-4d67-b57c-2288d341c9c0 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:54.173295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98f70-bed4-4d67-b57c-2288d341c9c0 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:54.193126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:54.237185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74174c3-b32c-4d72-82cd-d3d84649221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:54.237781 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74174c3-b32c-4d72-82cd-d3d84649221e admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:54.238044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74174c3-b32c-4d72-82cd-d3d84649221e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:54.238309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74174c3-b32c-4d72-82cd-d3d84649221e admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:54.238942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74174c3-b32c-4d72-82cd-d3d84649221e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:54.240938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74174c3-b32c-4d72-82cd-d3d84649221e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:54.265453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1288/2546] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:36:54 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:36:54.271912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d709fd-4b07-43ee-ac41-2cd81f855a4f admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:54.283329 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d709fd-4b07-43ee-ac41-2cd81f855a4f admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:54.289255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad690f0b-f732-4147-b27c-d4d7ffe40609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:54.289836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad690f0b-f732-4147-b27c-d4d7ffe40609 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:54.290109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad690f0b-f732-4147-b27c-d4d7ffe40609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:54.290373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad690f0b-f732-4147-b27c-d4d7ffe40609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:54.291007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad690f0b-f732-4147-b27c-d4d7ffe40609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:54.292619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad690f0b-f732-4147-b27c-d4d7ffe40609 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:54.303686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1259/2547] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:54.307744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74174c3-b32c-4d72-82cd-d3d84649221e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:54.318417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74174c3-b32c-4d72-82cd-d3d84649221e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:54.323774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420beb8-9587-4ef8-ad1e-cd206049ca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:54.324364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420beb8-9587-4ef8-ad1e-cd206049ca30 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:54.324666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420beb8-9587-4ef8-ad1e-cd206049ca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:54.324932 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420beb8-9587-4ef8-ad1e-cd206049ca30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:54.325569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420beb8-9587-4ef8-ad1e-cd206049ca30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:54.327166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420beb8-9587-4ef8-ad1e-cd206049ca30 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:54.337982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1289/2548] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:36:54.342143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad690f0b-f732-4147-b27c-d4d7ffe40609 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:54.353124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad690f0b-f732-4147-b27c-d4d7ffe40609 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:54.358777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859a2ac-f140-4839-910f-747b8bfc2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:54.359431 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859a2ac-f140-4839-910f-747b8bfc2948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:54.359711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859a2ac-f140-4839-910f-747b8bfc2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:54.359989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859a2ac-f140-4839-910f-747b8bfc2948 admin admin] PATH_INFO: `/v3/projects/b9eefeeda94f4fdbad6e5ee8b86410f3/users/e26943ed0bc844aeaa97b8da00524031/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:54.375471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859a2ac-f140-4839-910f-747b8bfc2948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9eefeeda94f4fdbad6e5ee8b86410f3, user_id=e26943ed0bc844aeaa97b8da00524031, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:54.378243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859a2ac-f140-4839-910f-747b8bfc2948 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:54.393933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1260/2549] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:36:54 2022] PUT /identity/v3/projects/b9eefeeda94f4fdbad6e5ee8b86410f3/users/e26943ed0bc844aeaa97b8da00524031/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:36:54.404271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e9b1-39b9-4c94-a88a-4abe143e55aa None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:54.404588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e9b1-39b9-4c94-a88a-4abe143e55aa None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:54.404864 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e9b1-39b9-4c94-a88a-4abe143e55aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:54.434052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-7073e9b1-39b9-4c94-a88a-4abe143e55aa None None] MFA Rules not processed for user `e26943ed0bc844aeaa97b8da00524031`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:54.435272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7073e9b1-39b9-4c94-a88a-4abe143e55aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:54.502316 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1290/2550] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:54.514042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859a2ac-f140-4839-910f-747b8bfc2948 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:54.515762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9859a2ac-f140-4839-910f-747b8bfc2948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:54.578653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859a2ac-f140-4839-910f-747b8bfc2948 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:54.582448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10e85b-a1c0-4f7a-95af-958d7c85a23b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:54.583065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10e85b-a1c0-4f7a-95af-958d7c85a23b service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:54.583344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10e85b-a1c0-4f7a-95af-958d7c85a23b service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:54.583616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10e85b-a1c0-4f7a-95af-958d7c85a23b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:54.592751 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10e85b-a1c0-4f7a-95af-958d7c85a23b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:54.594185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10e85b-a1c0-4f7a-95af-958d7c85a23b service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:54.603800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1261/2551] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:04.267769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e9b1-39b9-4c94-a88a-4abe143e55aa None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:04.354241 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e9b1-39b9-4c94-a88a-4abe143e55aa None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:04.360880 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:04.361507 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:04.361806 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:04.362062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] PATH_INFO: `/v3/users/e26943ed0bc844aeaa97b8da00524031` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:04.363289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26943ed0bc844aeaa97b8da00524031)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:04.365291 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:04.409088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:04.424682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26943ed0bc844aeaa97b8da00524031'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:04.425529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26943ed0bc844aeaa97b8da00524031'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:04.426178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26943ed0bc844aeaa97b8da00524031'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:04.433658 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26943ed0bc844aeaa97b8da00524031'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:04.451899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26943ed0bc844aeaa97b8da00524031'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:04.474443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1291/2552] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:37:04 2022] DELETE /identity/v3/users/e26943ed0bc844aeaa97b8da00524031 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:04.479310 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09e42b-5c4f-4189-9712-ed301d434a4e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:04.479810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09e42b-5c4f-4189-9712-ed301d434a4e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:04.480033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09e42b-5c4f-4189-9712-ed301d434a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:04.512359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-9e09e42b-5c4f-4189-9712-ed301d434a4e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:04.514346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9e09e42b-5c4f-4189-9712-ed301d434a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:04.558421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:04.590656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1262/2553] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:04.601450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:04.602888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:04.662637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa017ef-b6a4-4185-838e-8f3cbbaf86b1 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:04.666271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71b9e0-15c5-4c94-993c-a631bbcc617a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:04.666883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b9e0-15c5-4c94-993c-a631bbcc617a service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:04.667180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b9e0-15c5-4c94-993c-a631bbcc617a service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:04.667450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b9e0-15c5-4c94-993c-a631bbcc617a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:04.676722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71b9e0-15c5-4c94-993c-a631bbcc617a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:04.678162 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71b9e0-15c5-4c94-993c-a631bbcc617a service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:04.687834 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1292/2554] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:04.969552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09e42b-5c4f-4189-9712-ed301d434a4e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:04.971086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9e09e42b-5c4f-4189-9712-ed301d434a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:04.984827 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09e42b-5c4f-4189-9712-ed301d434a4e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:04.990295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:04.991091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:04.991373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:04.991643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] PATH_INFO: `/v3/projects/b9eefeeda94f4fdbad6e5ee8b86410f3` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:04.992899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9eefeeda94f4fdbad6e5ee8b86410f3)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:04.994917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:05.047084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9eefeeda94f4fdbad6e5ee8b86410f3', 'request_id': 'req-b3cf897d-71c2-4d7c-b34c-1107271f692d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:05.053707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9eefeeda94f4fdbad6e5ee8b86410f3', 'request_id': 'req-b3cf897d-71c2-4d7c-b34c-1107271f692d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:05.063180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9eefeeda94f4fdbad6e5ee8b86410f3', 'request_id': 'req-b3cf897d-71c2-4d7c-b34c-1107271f692d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:05.074302 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] The token cache is being invalidate because project b9eefeeda94f4fdbad6e5ee8b86410f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:37:05.074592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:05.075228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b3cf897d-71c2-4d7c-b34c-1107271f692d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:05.076830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1263/2555] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:37:04 2022] DELETE /identity/v3/projects/b9eefeeda94f4fdbad6e5ee8b86410f3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:05.081883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c988d-0916-42d0-9390-123ca7bd27a9 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.082172 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c988d-0916-42d0-9390-123ca7bd27a9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.082449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c988d-0916-42d0-9390-123ca7bd27a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.103354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-9b0c988d-0916-42d0-9390-123ca7bd27a9 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:05.104682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9b0c988d-0916-42d0-9390-123ca7bd27a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:05.167786 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1293/2556] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:05.177542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6dd36-6900-4a38-9de9-aa94a1dae991 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.177990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6dd36-6900-4a38-9de9-aa94a1dae991 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.178356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6dd36-6900-4a38-9de9-aa94a1dae991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.207581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6ac6dd36-6900-4a38-9de9-aa94a1dae991 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:05.208742 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6ac6dd36-6900-4a38-9de9-aa94a1dae991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:05.217704 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1264/2557] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:05.222100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c988d-0916-42d0-9390-123ca7bd27a9 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:05.232244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c988d-0916-42d0-9390-123ca7bd27a9 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:05.237077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099244-6f1f-4883-afac-d7d0063882a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:05.237702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099244-6f1f-4883-afac-d7d0063882a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.237975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099244-6f1f-4883-afac-d7d0063882a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.238239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099244-6f1f-4883-afac-d7d0063882a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.238870 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99099244-6f1f-4883-afac-d7d0063882a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:37:05.239187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99099244-6f1f-4883-afac-d7d0063882a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:05.240911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99099244-6f1f-4883-afac-d7d0063882a4 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:05.254470 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1294/2558] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:37:05.259076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6dd36-6900-4a38-9de9-aa94a1dae991 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:05.269668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6dd36-6900-4a38-9de9-aa94a1dae991 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:05.275026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826e8a7-f239-4db2-815c-bd3e7e402f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:05.275640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826e8a7-f239-4db2-815c-bd3e7e402f82 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.275943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826e8a7-f239-4db2-815c-bd3e7e402f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.276193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826e8a7-f239-4db2-815c-bd3e7e402f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.276914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826e8a7-f239-4db2-815c-bd3e7e402f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:05.278834 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826e8a7-f239-4db2-815c-bd3e7e402f82 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:05.308848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1265/2559] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:37:05 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:05.313177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099244-6f1f-4883-afac-d7d0063882a4 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:05.323278 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099244-6f1f-4883-afac-d7d0063882a4 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:05.358711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:05.384258 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ad73b-83d8-48e8-a6c7-611e89dd97ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:05.384910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ad73b-83d8-48e8-a6c7-611e89dd97ae admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.385190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ad73b-83d8-48e8-a6c7-611e89dd97ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.385462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ad73b-83d8-48e8-a6c7-611e89dd97ae admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.386104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ad73b-83d8-48e8-a6c7-611e89dd97ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:05.388047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ad73b-83d8-48e8-a6c7-611e89dd97ae admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:05.409208 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1295/2560] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:37:05 2022] POST /identity/v3/users => generated 281 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:05.413562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826e8a7-f239-4db2-815c-bd3e7e402f82 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:05.425436 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826e8a7-f239-4db2-815c-bd3e7e402f82 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:05.431840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6da882-9649-4d4d-be24-e145730b3152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:05.432495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6da882-9649-4d4d-be24-e145730b3152 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.432778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6da882-9649-4d4d-be24-e145730b3152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.433034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6da882-9649-4d4d-be24-e145730b3152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.433688 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6da882-9649-4d4d-be24-e145730b3152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:05.435396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6da882-9649-4d4d-be24-e145730b3152 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:05.446212 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1266/2561] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:05.450410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ad73b-83d8-48e8-a6c7-611e89dd97ae admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:05.461388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ad73b-83d8-48e8-a6c7-611e89dd97ae admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:05.467440 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0606d-ce9e-4172-abd6-a71d81523b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:05.468045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0606d-ce9e-4172-abd6-a71d81523b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.468320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0606d-ce9e-4172-abd6-a71d81523b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.468615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0606d-ce9e-4172-abd6-a71d81523b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.469258 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0606d-ce9e-4172-abd6-a71d81523b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:05.470867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0606d-ce9e-4172-abd6-a71d81523b5f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:05.481361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1296/2562] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:05.485744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6da882-9649-4d4d-be24-e145730b3152 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:05.496122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6da882-9649-4d4d-be24-e145730b3152 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:05.501084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0421595-a948-4d55-92f6-d3e759b14552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:05.501741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0421595-a948-4d55-92f6-d3e759b14552 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.502021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0421595-a948-4d55-92f6-d3e759b14552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.502293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0421595-a948-4d55-92f6-d3e759b14552 admin admin] PATH_INFO: `/v3/projects/391bec5a60254e1daaa4e6d7f46ae5f9/users/63f2508ef27640d6923a308c68ba0036/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.517851 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0421595-a948-4d55-92f6-d3e759b14552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391bec5a60254e1daaa4e6d7f46ae5f9, user_id=63f2508ef27640d6923a308c68ba0036, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:05.520607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0421595-a948-4d55-92f6-d3e759b14552 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:05.535564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1267/2563] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:37:05 2022] PUT /identity/v3/projects/391bec5a60254e1daaa4e6d7f46ae5f9/users/63f2508ef27640d6923a308c68ba0036/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:37:05.546439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c7cc7-157b-49c5-b613-ee4c1e4c625e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.546762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c7cc7-157b-49c5-b613-ee4c1e4c625e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.547032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c7cc7-157b-49c5-b613-ee4c1e4c625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.574808 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-048c7cc7-157b-49c5-b613-ee4c1e4c625e None None] MFA Rules not processed for user `63f2508ef27640d6923a308c68ba0036`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:05.576028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-048c7cc7-157b-49c5-b613-ee4c1e4c625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:05.641722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1297/2564] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:05.675992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0421595-a948-4d55-92f6-d3e759b14552 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:05.678075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a0421595-a948-4d55-92f6-d3e759b14552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:05.740338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0421595-a948-4d55-92f6-d3e759b14552 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:05.744527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09190a5a-8955-475a-b9a0-ca8269a15809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:05.745119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09190a5a-8955-475a-b9a0-ca8269a15809 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.745402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09190a5a-8955-475a-b9a0-ca8269a15809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.745677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09190a5a-8955-475a-b9a0-ca8269a15809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.754797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09190a5a-8955-475a-b9a0-ca8269a15809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:05.756246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09190a5a-8955-475a-b9a0-ca8269a15809 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:05.761120 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:05.766805 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1268/2565] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:05.782596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c7cc7-157b-49c5-b613-ee4c1e4c625e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:05.845526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c7cc7-157b-49c5-b613-ee4c1e4c625e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:05.851346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:05.851974 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.852250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.852514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] PATH_INFO: `/v3/users/63f2508ef27640d6923a308c68ba0036` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.853736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f2508ef27640d6923a308c68ba0036)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:05.855668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:05.908271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f2508ef27640d6923a308c68ba0036'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:05.908927 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f2508ef27640d6923a308c68ba0036'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:05.909515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f2508ef27640d6923a308c68ba0036'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:05.910675 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:05.918788 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f2508ef27640d6923a308c68ba0036'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:05.930747 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f2508ef27640d6923a308c68ba0036'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:05.949020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1298/2566] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:37:05 2022] DELETE /identity/v3/users/63f2508ef27640d6923a308c68ba0036 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:05.953960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d032-e968-4308-83d3-3284d54953ba None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:05.954248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d032-e968-4308-83d3-3284d54953ba None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:05.954526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d032-e968-4308-83d3-3284d54953ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:05.974175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6909d032-e968-4308-83d3-3284d54953ba None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:05.975705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6909d032-e968-4308-83d3-3284d54953ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:06.046846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1269/2567] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:06.056893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:06.058368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:06.119818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86806bfc-55f4-4dd4-94f4-ad75557bce94 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:06.123447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d411c7-ab17-431e-8bcd-9a1393086063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:06.124056 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d411c7-ab17-431e-8bcd-9a1393086063 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:06.124333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d411c7-ab17-431e-8bcd-9a1393086063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:06.124572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cf2b0-2855-4f5c-b6b7-80573e2e20b7 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:06.124667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d411c7-ab17-431e-8bcd-9a1393086063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:06.124905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cf2b0-2855-4f5c-b6b7-80573e2e20b7 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:06.125169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cf2b0-2855-4f5c-b6b7-80573e2e20b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:06.135438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d411c7-ab17-431e-8bcd-9a1393086063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:06.136962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d411c7-ab17-431e-8bcd-9a1393086063 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:06.144573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-167cf2b0-2855-4f5c-b6b7-80573e2e20b7 None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:06.145830 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-167cf2b0-2855-4f5c-b6b7-80573e2e20b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:06.147458 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1299/2568] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:06.206843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1270/2569] 10.222.0.49 () {58 vars in 967 bytes} [Fri Sep 16 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:37:06.220849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d411c7-ab17-431e-8bcd-9a1393086063 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:06.222300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c1d411c7-ab17-431e-8bcd-9a1393086063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:06.294683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d411c7-ab17-431e-8bcd-9a1393086063 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:06.300699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f881aeb-951c-467c-99bc-6782ddeae619 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:06.301324 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f881aeb-951c-467c-99bc-6782ddeae619 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:06.301608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f881aeb-951c-467c-99bc-6782ddeae619 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:06.302388 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f881aeb-951c-467c-99bc-6782ddeae619 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:06.310995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f881aeb-951c-467c-99bc-6782ddeae619 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:06.312757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f881aeb-951c-467c-99bc-6782ddeae619 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:06.321246 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1300/2570] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:37:06.445286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cf2b0-2855-4f5c-b6b7-80573e2e20b7 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:06.447000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-167cf2b0-2855-4f5c-b6b7-80573e2e20b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:06.471794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cf2b0-2855-4f5c-b6b7-80573e2e20b7 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:06.479305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:06.480323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:06.480652 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:06.480987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] PATH_INFO: `/v3/projects/391bec5a60254e1daaa4e6d7f46ae5f9` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:06.482255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=391bec5a60254e1daaa4e6d7f46ae5f9)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:06.484418 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:06.567533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391bec5a60254e1daaa4e6d7f46ae5f9', 'request_id': 'req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:06.574844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391bec5a60254e1daaa4e6d7f46ae5f9', 'request_id': 'req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:06.585657 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391bec5a60254e1daaa4e6d7f46ae5f9', 'request_id': 'req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:06.597383 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] The token cache is being invalidate because project 391bec5a60254e1daaa4e6d7f46ae5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:37:06.597666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:06.598319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-4e1a9f9e-0cb7-42ee-841e-5d97111e10ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:06.600087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1271/2571] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:37:06 2022] DELETE /identity/v3/projects/391bec5a60254e1daaa4e6d7f46ae5f9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:37:06.606647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5724de-a8c9-47d5-83d6-c54095981e19 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:06.606982 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5724de-a8c9-47d5-83d6-c54095981e19 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:06.607381 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5724de-a8c9-47d5-83d6-c54095981e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:06.629087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3b5724de-a8c9-47d5-83d6-c54095981e19 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:06.630383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3b5724de-a8c9-47d5-83d6-c54095981e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:06.681598 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:06.692870 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1301/2572] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:06.700845 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f7532-ba90-4763-935e-4ada163753ed None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:06.701136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f7532-ba90-4763-935e-4ada163753ed None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:06.701416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f7532-ba90-4763-935e-4ada163753ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:06.722283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-639f7532-ba90-4763-935e-4ada163753ed None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:06.723514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-639f7532-ba90-4763-935e-4ada163753ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:06.731971 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1272/2573] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:06.737094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5724de-a8c9-47d5-83d6-c54095981e19 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:06.747141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5724de-a8c9-47d5-83d6-c54095981e19 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:06.752770 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81be5fb-4fb5-40a1-a0e5-bd9327dde6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:06.753420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81be5fb-4fb5-40a1-a0e5-bd9327dde6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:06.753683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81be5fb-4fb5-40a1-a0e5-bd9327dde6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:06.753969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81be5fb-4fb5-40a1-a0e5-bd9327dde6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:06.754624 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81be5fb-4fb5-40a1-a0e5-bd9327dde6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:37:06.754925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81be5fb-4fb5-40a1-a0e5-bd9327dde6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:06.756564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81be5fb-4fb5-40a1-a0e5-bd9327dde6cd admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:06.770060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1302/2574] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:37:06.774620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f7532-ba90-4763-935e-4ada163753ed None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:06.784332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f7532-ba90-4763-935e-4ada163753ed None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:06.789217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45aaf2-d49d-44c6-84fe-7c53bf9651c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:06.789823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45aaf2-d49d-44c6-84fe-7c53bf9651c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:06.790102 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45aaf2-d49d-44c6-84fe-7c53bf9651c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:06.790375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45aaf2-d49d-44c6-84fe-7c53bf9651c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:06.791063 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45aaf2-d49d-44c6-84fe-7c53bf9651c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:06.793019 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45aaf2-d49d-44c6-84fe-7c53bf9651c3 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:06.818208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:06.825891 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1273/2575] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:37:06 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:37:06.830292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81be5fb-4fb5-40a1-a0e5-bd9327dde6cd admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:06.845793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81be5fb-4fb5-40a1-a0e5-bd9327dde6cd admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:06.911879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cca88-8b7f-439f-ae38-01b9151ada4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:06.912813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cca88-8b7f-439f-ae38-01b9151ada4c admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:06.913755 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cca88-8b7f-439f-ae38-01b9151ada4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:06.914224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cca88-8b7f-439f-ae38-01b9151ada4c admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:06.914876 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cca88-8b7f-439f-ae38-01b9151ada4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:06.916859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cca88-8b7f-439f-ae38-01b9151ada4c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:06.942331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1303/2576] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:37:06 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:37:06.946493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45aaf2-d49d-44c6-84fe-7c53bf9651c3 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:06.958794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45aaf2-d49d-44c6-84fe-7c53bf9651c3 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:06.964573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93401c-4be6-49e0-88de-4818af5ff5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:06.965191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93401c-4be6-49e0-88de-4818af5ff5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:06.965481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93401c-4be6-49e0-88de-4818af5ff5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:06.965738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93401c-4be6-49e0-88de-4818af5ff5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:06.966387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93401c-4be6-49e0-88de-4818af5ff5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:06.967980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93401c-4be6-49e0-88de-4818af5ff5e7 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:06.980441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1274/2577] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:37:06.983772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cca88-8b7f-439f-ae38-01b9151ada4c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:06.994795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cca88-8b7f-439f-ae38-01b9151ada4c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:06.999828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0657048-f3be-4522-8ae8-06a86a2b77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:07.000576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0657048-f3be-4522-8ae8-06a86a2b77d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:07.000849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0657048-f3be-4522-8ae8-06a86a2b77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:07.001117 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0657048-f3be-4522-8ae8-06a86a2b77d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:07.002360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0657048-f3be-4522-8ae8-06a86a2b77d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:07.003996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0657048-f3be-4522-8ae8-06a86a2b77d1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:07.016616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1304/2578] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:07.020891 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93401c-4be6-49e0-88de-4818af5ff5e7 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:07.030889 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93401c-4be6-49e0-88de-4818af5ff5e7 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:07.035813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7563e-5d75-42a9-98bb-9d79c2056f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:07.036494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7563e-5d75-42a9-98bb-9d79c2056f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:07.036770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7563e-5d75-42a9-98bb-9d79c2056f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:07.037040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7563e-5d75-42a9-98bb-9d79c2056f53 admin admin] PATH_INFO: `/v3/projects/c78573e04ec74240b397bdb167b5ec4c/users/2d0daefb622b4123a54a3837afd75b04/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:07.052023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7563e-5d75-42a9-98bb-9d79c2056f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78573e04ec74240b397bdb167b5ec4c, user_id=2d0daefb622b4123a54a3837afd75b04, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:07.054751 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7563e-5d75-42a9-98bb-9d79c2056f53 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:07.069942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1275/2579] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:37:07 2022] PUT /identity/v3/projects/c78573e04ec74240b397bdb167b5ec4c/users/2d0daefb622b4123a54a3837afd75b04/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:37:07.081099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48a84d-4de7-42e3-8872-d1c9d0b0d9d4 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:07.081393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48a84d-4de7-42e3-8872-d1c9d0b0d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:07.081669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48a84d-4de7-42e3-8872-d1c9d0b0d9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:07.115868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4b48a84d-4de7-42e3-8872-d1c9d0b0d9d4 None None] MFA Rules not processed for user `2d0daefb622b4123a54a3837afd75b04`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:07.117081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4b48a84d-4de7-42e3-8872-d1c9d0b0d9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:07.182689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1305/2580] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:07.194540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7563e-5d75-42a9-98bb-9d79c2056f53 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:07.196339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-03c7563e-5d75-42a9-98bb-9d79c2056f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:07.254384 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7563e-5d75-42a9-98bb-9d79c2056f53 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:07.258844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d04c1-1643-47f6-8c95-90bf5c8d8161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:07.259665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d04c1-1643-47f6-8c95-90bf5c8d8161 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:07.259811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d04c1-1643-47f6-8c95-90bf5c8d8161 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:07.259979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d04c1-1643-47f6-8c95-90bf5c8d8161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:07.269647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d04c1-1643-47f6-8c95-90bf5c8d8161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:07.271113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d04c1-1643-47f6-8c95-90bf5c8d8161 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:07.280620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1276/2581] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:17.179346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:17.276015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:36.779353 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48a84d-4de7-42e3-8872-d1c9d0b0d9d4 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:36.780955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4b48a84d-4de7-42e3-8872-d1c9d0b0d9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:36.846074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48a84d-4de7-42e3-8872-d1c9d0b0d9d4 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:36.850532 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a224bf-2e06-4417-8e1c-2e5dd28b8ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:36.851143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a224bf-2e06-4417-8e1c-2e5dd28b8ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:36.851417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a224bf-2e06-4417-8e1c-2e5dd28b8ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:36.851689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a224bf-2e06-4417-8e1c-2e5dd28b8ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:36.853751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-85a224bf-2e06-4417-8e1c-2e5dd28b8ef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:36.918365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a224bf-2e06-4417-8e1c-2e5dd28b8ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:36.919833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a224bf-2e06-4417-8e1c-2e5dd28b8ef6 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:36.929715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1306/2582] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:39.886893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d04c1-1643-47f6-8c95-90bf5c8d8161 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:39.886893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a75d04c1-1643-47f6-8c95-90bf5c8d8161 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:39.905405 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d04c1-1643-47f6-8c95-90bf5c8d8161 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:39.909876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:39.910504 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:39.910776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:39.911045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] PATH_INFO: `/v3/users/92f0c702f8ce49a99a10175b0ce68685` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:39.925247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f0c702f8ce49a99a10175b0ce68685)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:39.927187 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:39.977038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f0c702f8ce49a99a10175b0ce68685'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:39.977705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f0c702f8ce49a99a10175b0ce68685'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:39.985234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f0c702f8ce49a99a10175b0ce68685'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:39.998138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f0c702f8ce49a99a10175b0ce68685'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:39.998881 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-007228f6-1ee9-40f7-a4c9-0b0175157b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f0c702f8ce49a99a10175b0ce68685'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:40.014879 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1277/2583] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:37:39 2022] DELETE /identity/v3/users/92f0c702f8ce49a99a10175b0ce68685 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:40.190840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a224bf-2e06-4417-8e1c-2e5dd28b8ef6 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:40.202947 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a224bf-2e06-4417-8e1c-2e5dd28b8ef6 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:40.265315 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:40.265952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:40.266226 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:40.266495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] PATH_INFO: `/v3/projects/1983ce4dc9bd4050a2399d9f62d3e871` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:40.277144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1983ce4dc9bd4050a2399d9f62d3e871)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:40.279060 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:40.326678 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:40.330589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1983ce4dc9bd4050a2399d9f62d3e871', 'request_id': 'req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:40.338892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1983ce4dc9bd4050a2399d9f62d3e871', 'request_id': 'req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:40.344774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1983ce4dc9bd4050a2399d9f62d3e871', 'request_id': 'req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:40.360181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] The token cache is being invalidate because project 1983ce4dc9bd4050a2399d9f62d3e871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:37:40.360524 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:40.361157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-fd7fd5ea-19ea-46c5-b3b0-06055e87abf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:40.362700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1307/2584] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:37:40 2022] DELETE /identity/v3/projects/1983ce4dc9bd4050a2399d9f62d3e871 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:40.369089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aeb8a-bb75-4239-a120-eecabbffe679 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:40.369374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aeb8a-bb75-4239-a120-eecabbffe679 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:40.369645 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aeb8a-bb75-4239-a120-eecabbffe679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:40.390244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-499aeb8a-bb75-4239-a120-eecabbffe679 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:40.391448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-499aeb8a-bb75-4239-a120-eecabbffe679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:40.455500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1278/2585] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:40.465633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5e7a-1b25-4c30-bc27-6d760f9eb939 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:40.465921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5e7a-1b25-4c30-bc27-6d760f9eb939 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:40.466192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5e7a-1b25-4c30-bc27-6d760f9eb939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:40.487904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-bd9a5e7a-1b25-4c30-bc27-6d760f9eb939 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:40.489505 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-bd9a5e7a-1b25-4c30-bc27-6d760f9eb939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:40.499702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1308/2586] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:40.504315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aeb8a-bb75-4239-a120-eecabbffe679 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:40.515728 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aeb8a-bb75-4239-a120-eecabbffe679 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:40.520926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a964ebc-5f71-45bf-ab6b-62cae43a1033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:40.521582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a964ebc-5f71-45bf-ab6b-62cae43a1033 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:40.521861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a964ebc-5f71-45bf-ab6b-62cae43a1033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:40.522152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a964ebc-5f71-45bf-ab6b-62cae43a1033 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:40.523050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a964ebc-5f71-45bf-ab6b-62cae43a1033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:37:40.523371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a964ebc-5f71-45bf-ab6b-62cae43a1033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:40.525014 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a964ebc-5f71-45bf-ab6b-62cae43a1033 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:40.537032 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1279/2587] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:37:40.542177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5e7a-1b25-4c30-bc27-6d760f9eb939 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:40.552751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5e7a-1b25-4c30-bc27-6d760f9eb939 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:40.559085 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2562ba-cf56-4adc-a42e-995ab8e37995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:40.559705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2562ba-cf56-4adc-a42e-995ab8e37995 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:40.559988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2562ba-cf56-4adc-a42e-995ab8e37995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:40.560254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2562ba-cf56-4adc-a42e-995ab8e37995 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:40.560939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2562ba-cf56-4adc-a42e-995ab8e37995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:40.562882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2562ba-cf56-4adc-a42e-995ab8e37995 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:40.595069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1309/2588] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:37:40 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:40.599237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a964ebc-5f71-45bf-ab6b-62cae43a1033 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:40.611194 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a964ebc-5f71-45bf-ab6b-62cae43a1033 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:40.658202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:40.673301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7224340-d214-43d4-9f51-3b24d0e1f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:40.673838 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7224340-d214-43d4-9f51-3b24d0e1f71a admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:40.674360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7224340-d214-43d4-9f51-3b24d0e1f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:40.674651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7224340-d214-43d4-9f51-3b24d0e1f71a admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:40.677087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7224340-d214-43d4-9f51-3b24d0e1f71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:40.679770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7224340-d214-43d4-9f51-3b24d0e1f71a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:40.702569 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1280/2589] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:37:40 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:40.706789 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2562ba-cf56-4adc-a42e-995ab8e37995 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:40.718391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2562ba-cf56-4adc-a42e-995ab8e37995 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:40.723456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf85ff-747a-448a-a2e9-b77ae6be124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:40.724051 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf85ff-747a-448a-a2e9-b77ae6be124d admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:40.724329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf85ff-747a-448a-a2e9-b77ae6be124d admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:40.724635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf85ff-747a-448a-a2e9-b77ae6be124d admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:40.725265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf85ff-747a-448a-a2e9-b77ae6be124d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:40.727254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf85ff-747a-448a-a2e9-b77ae6be124d admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:40.738083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1310/2590] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:37:40.742304 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7224340-d214-43d4-9f51-3b24d0e1f71a admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:40.752690 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7224340-d214-43d4-9f51-3b24d0e1f71a admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:40.758393 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95800144-b6d6-4a52-9d04-0706b921855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:40.759012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95800144-b6d6-4a52-9d04-0706b921855a admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:40.759291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95800144-b6d6-4a52-9d04-0706b921855a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:40.759560 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95800144-b6d6-4a52-9d04-0706b921855a admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:40.760213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95800144-b6d6-4a52-9d04-0706b921855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:40.761872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95800144-b6d6-4a52-9d04-0706b921855a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:40.773407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1281/2591] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:40.780251 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf85ff-747a-448a-a2e9-b77ae6be124d admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:40.793450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf85ff-747a-448a-a2e9-b77ae6be124d admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:40.798641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5fe30-9dde-4137-9194-6ae363f5ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:40.799294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5fe30-9dde-4137-9194-6ae363f5ec23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:40.799629 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5fe30-9dde-4137-9194-6ae363f5ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:40.799885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5fe30-9dde-4137-9194-6ae363f5ec23 admin admin] PATH_INFO: `/v3/projects/fa78bfa54c6d49f0a21502ac6bccca42/users/0cf2c33772664caeb4f9a226b0064192/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:40.815453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5fe30-9dde-4137-9194-6ae363f5ec23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa78bfa54c6d49f0a21502ac6bccca42, user_id=0cf2c33772664caeb4f9a226b0064192, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:40.818206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5fe30-9dde-4137-9194-6ae363f5ec23 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:40.835460 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1311/2592] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:37:40 2022] PUT /identity/v3/projects/fa78bfa54c6d49f0a21502ac6bccca42/users/0cf2c33772664caeb4f9a226b0064192/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:40.847996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80d14a-c886-48f5-9258-caab4127a68f None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:40.848352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80d14a-c886-48f5-9258-caab4127a68f None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:40.848651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80d14a-c886-48f5-9258-caab4127a68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:40.887960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-2b80d14a-c886-48f5-9258-caab4127a68f None None] MFA Rules not processed for user `0cf2c33772664caeb4f9a226b0064192`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:40.889215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2b80d14a-c886-48f5-9258-caab4127a68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:40.954895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1282/2593] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:40.959526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5fe30-9dde-4137-9194-6ae363f5ec23 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:41.022304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5fe30-9dde-4137-9194-6ae363f5ec23 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:41.027365 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ad54d-7ca3-4e10-a2bf-6db32805f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:41.027963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ad54d-7ca3-4e10-a2bf-6db32805f168 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:41.028233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ad54d-7ca3-4e10-a2bf-6db32805f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:41.028531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ad54d-7ca3-4e10-a2bf-6db32805f168 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:41.029157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ad54d-7ca3-4e10-a2bf-6db32805f168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:41.031062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ad54d-7ca3-4e10-a2bf-6db32805f168 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:41.060825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1312/2594] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:37:40 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:41.064975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80d14a-c886-48f5-9258-caab4127a68f None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:41.076353 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80d14a-c886-48f5-9258-caab4127a68f None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:41.144348 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6d15-18a8-438f-a0f3-dd283d719817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:41.144896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6d15-18a8-438f-a0f3-dd283d719817 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:41.145176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6d15-18a8-438f-a0f3-dd283d719817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:41.145508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6d15-18a8-438f-a0f3-dd283d719817 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:41.146168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b6d15-18a8-438f-a0f3-dd283d719817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:41.148217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b6d15-18a8-438f-a0f3-dd283d719817 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:41.174408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1283/2595] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:37:41 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:37:41.180086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ad54d-7ca3-4e10-a2bf-6db32805f168 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:41.190920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ad54d-7ca3-4e10-a2bf-6db32805f168 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:41.196574 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a90e9-6e3f-464a-969e-4c7e496b97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:41.197180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a90e9-6e3f-464a-969e-4c7e496b97bb admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:41.197596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a90e9-6e3f-464a-969e-4c7e496b97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:41.197872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a90e9-6e3f-464a-969e-4c7e496b97bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:41.198523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a90e9-6e3f-464a-969e-4c7e496b97bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:41.200135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a90e9-6e3f-464a-969e-4c7e496b97bb admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:41.211800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1313/2596] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:37:41.217586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6d15-18a8-438f-a0f3-dd283d719817 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:41.228374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6d15-18a8-438f-a0f3-dd283d719817 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:41.233587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e4af4-67d3-4ba9-814f-77b1df934a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:41.234244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e4af4-67d3-4ba9-814f-77b1df934a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:41.234527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e4af4-67d3-4ba9-814f-77b1df934a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:41.234807 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e4af4-67d3-4ba9-814f-77b1df934a2b admin admin] PATH_INFO: `/v3/projects/04b4a7fdf932431eb35cfda1d362b60c/users/17d597b52bf9430999d6fe70e8f0f072/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:41.250442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e4af4-67d3-4ba9-814f-77b1df934a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b4a7fdf932431eb35cfda1d362b60c, user_id=17d597b52bf9430999d6fe70e8f0f072, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:41.253196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e4af4-67d3-4ba9-814f-77b1df934a2b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:41.268776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1284/2597] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:37:41 2022] PUT /identity/v3/projects/04b4a7fdf932431eb35cfda1d362b60c/users/17d597b52bf9430999d6fe70e8f0f072/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:41.272973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a90e9-6e3f-464a-969e-4c7e496b97bb admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:41.283691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a90e9-6e3f-464a-969e-4c7e496b97bb admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:41.323852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:41.342252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2bdc3-1e50-4860-8c4b-beeb37e6eee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:41.342869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2bdc3-1e50-4860-8c4b-beeb37e6eee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:41.343152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2bdc3-1e50-4860-8c4b-beeb37e6eee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:41.343427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2bdc3-1e50-4860-8c4b-beeb37e6eee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:41.344078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2bdc3-1e50-4860-8c4b-beeb37e6eee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:41.345735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2bdc3-1e50-4860-8c4b-beeb37e6eee9 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:41.355614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1314/2598] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:41.360016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e4af4-67d3-4ba9-814f-77b1df934a2b admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:41.371684 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e4af4-67d3-4ba9-814f-77b1df934a2b admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:41.377158 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921f0c4-be36-4455-87d2-e5565ab18717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:41.377812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921f0c4-be36-4455-87d2-e5565ab18717 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:41.378090 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921f0c4-be36-4455-87d2-e5565ab18717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:41.378363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921f0c4-be36-4455-87d2-e5565ab18717 admin admin] PATH_INFO: `/v3/projects/04b4a7fdf932431eb35cfda1d362b60c/users/17d597b52bf9430999d6fe70e8f0f072/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:41.380410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921f0c4-be36-4455-87d2-e5565ab18717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b4a7fdf932431eb35cfda1d362b60c, user_id=17d597b52bf9430999d6fe70e8f0f072, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:41.383621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921f0c4-be36-4455-87d2-e5565ab18717 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:41.394643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1285/2599] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:37:41 2022] PUT /identity/v3/projects/04b4a7fdf932431eb35cfda1d362b60c/users/17d597b52bf9430999d6fe70e8f0f072/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:41.405235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d2a3-d40b-4849-803c-f531b285e652 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:41.405520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d2a3-d40b-4849-803c-f531b285e652 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:41.405833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d2a3-d40b-4849-803c-f531b285e652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:41.435243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1592d2a3-d40b-4849-803c-f531b285e652 None None] MFA Rules not processed for user `17d597b52bf9430999d6fe70e8f0f072`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:41.436526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1592d2a3-d40b-4849-803c-f531b285e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:41.506893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1315/2600] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:41.518592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921f0c4-be36-4455-87d2-e5565ab18717 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:41.520707 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a921f0c4-be36-4455-87d2-e5565ab18717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:41.533373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:41.587463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921f0c4-be36-4455-87d2-e5565ab18717 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:41.591529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13d506-af0a-4d8a-9c02-2db72c3ab5f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:41.592144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13d506-af0a-4d8a-9c02-2db72c3ab5f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:41.592414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13d506-af0a-4d8a-9c02-2db72c3ab5f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:41.592700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13d506-af0a-4d8a-9c02-2db72c3ab5f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:41.602039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13d506-af0a-4d8a-9c02-2db72c3ab5f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:41.603475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13d506-af0a-4d8a-9c02-2db72c3ab5f9 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:41.612975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1286/2601] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:41.661858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592d2a3-d40b-4849-803c-f531b285e652 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:41.663450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1592d2a3-d40b-4849-803c-f531b285e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:41.676220 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592d2a3-d40b-4849-803c-f531b285e652 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:41.680883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb11a4d-3ccb-48c6-993b-3390a73d0bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:41.681501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11a4d-3ccb-48c6-993b-3390a73d0bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:41.681783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11a4d-3ccb-48c6-993b-3390a73d0bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:41.682179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11a4d-3ccb-48c6-993b-3390a73d0bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:41.741193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb11a4d-3ccb-48c6-993b-3390a73d0bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:41.742655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb11a4d-3ccb-48c6-993b-3390a73d0bc1 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:41.751762 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1316/2602] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:45.139972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13d506-af0a-4d8a-9c02-2db72c3ab5f9 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:45.209129 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13d506-af0a-4d8a-9c02-2db72c3ab5f9 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:45.214382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:45.215167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:45.215167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:45.215711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] PATH_INFO: `/v3/users/0cf2c33772664caeb4f9a226b0064192` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:45.216915 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf2c33772664caeb4f9a226b0064192)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:45.218858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:45.270443 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf2c33772664caeb4f9a226b0064192'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:45.271098 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf2c33772664caeb4f9a226b0064192'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:45.278572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf2c33772664caeb4f9a226b0064192'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:45.290454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf2c33772664caeb4f9a226b0064192'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:45.291107 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf2c33772664caeb4f9a226b0064192'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:45.305988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1287/2603] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:37:45 2022] DELETE /identity/v3/users/0cf2c33772664caeb4f9a226b0064192 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:45.310800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd7c2-ac30-467f-8032-7bba8946d72e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:45.311328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd7c2-ac30-467f-8032-7bba8946d72e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:45.311328 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd7c2-ac30-467f-8032-7bba8946d72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:45.331840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-9c0cd7c2-ac30-467f-8032-7bba8946d72e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:45.333071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9c0cd7c2-ac30-467f-8032-7bba8946d72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:45.395736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1317/2604] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:45.405237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:45.406785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:45.443836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:45.471190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70554d66-e590-43ea-aae2-4c10d3fcfff1 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:45.475012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1f52c-d8d7-4ce6-925b-d45e5df66749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:45.475653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1f52c-d8d7-4ce6-925b-d45e5df66749 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:45.475935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1f52c-d8d7-4ce6-925b-d45e5df66749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:45.476208 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1f52c-d8d7-4ce6-925b-d45e5df66749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:45.485746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1f52c-d8d7-4ce6-925b-d45e5df66749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:45.487195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1f52c-d8d7-4ce6-925b-d45e5df66749 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:45.497732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1288/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:45.786271 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cd7c2-ac30-467f-8032-7bba8946d72e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:45.787895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9c0cd7c2-ac30-467f-8032-7bba8946d72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:45.795926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=100 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:45.802279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cd7c2-ac30-467f-8032-7bba8946d72e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:45.807712 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:45.808366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:45.808781 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:45.809181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] PATH_INFO: `/v3/projects/fa78bfa54c6d49f0a21502ac6bccca42` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:45.810437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa78bfa54c6d49f0a21502ac6bccca42)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:45.812358 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:45.866531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa78bfa54c6d49f0a21502ac6bccca42', 'request_id': 'req-34d11f04-80c6-4a0a-ab12-54cf76e8e951'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:45.874022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa78bfa54c6d49f0a21502ac6bccca42', 'request_id': 'req-34d11f04-80c6-4a0a-ab12-54cf76e8e951'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:45.880826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa78bfa54c6d49f0a21502ac6bccca42', 'request_id': 'req-34d11f04-80c6-4a0a-ab12-54cf76e8e951'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:45.898708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] The token cache is being invalidate because project fa78bfa54c6d49f0a21502ac6bccca42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:37:45.898936 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:45.899728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:45.901661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1318/2606] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:37:45 2022] DELETE /identity/v3/projects/fa78bfa54c6d49f0a21502ac6bccca42 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:45.906632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1f52c-d8d7-4ce6-925b-d45e5df66749 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:45.917319 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1f52c-d8d7-4ce6-925b-d45e5df66749 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:45.985387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:45.986020 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:45.986293 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:45.986562 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] PATH_INFO: `/v3/users/17d597b52bf9430999d6fe70e8f0f072` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:45.987726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d597b52bf9430999d6fe70e8f0f072)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:45.989755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:46.045423 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d597b52bf9430999d6fe70e8f0f072'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:46.046074 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d597b52bf9430999d6fe70e8f0f072'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:46.052850 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d597b52bf9430999d6fe70e8f0f072'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:46.066180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d597b52bf9430999d6fe70e8f0f072'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:46.066922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-09c10c40-b695-48bd-90ce-1e78c3a8cad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d597b52bf9430999d6fe70e8f0f072'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:46.081973 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1289/2607] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:37:45 2022] DELETE /identity/v3/users/17d597b52bf9430999d6fe70e8f0f072 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:37:46.367420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:46.369435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:46.385047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d11f04-80c6-4a0a-ab12-54cf76e8e951 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:46.446041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:46.446686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:46.446963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:46.447235 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] PATH_INFO: `/v3/projects/04b4a7fdf932431eb35cfda1d362b60c` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:46.448357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b4a7fdf932431eb35cfda1d362b60c)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:46.450653 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:46.498230 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b4a7fdf932431eb35cfda1d362b60c', 'request_id': 'req-d8487b14-0a44-4166-899d-24d88c68a769'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:46.504558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b4a7fdf932431eb35cfda1d362b60c', 'request_id': 'req-d8487b14-0a44-4166-899d-24d88c68a769'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:46.510103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b4a7fdf932431eb35cfda1d362b60c', 'request_id': 'req-d8487b14-0a44-4166-899d-24d88c68a769'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:46.524644 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] The token cache is being invalidate because project 04b4a7fdf932431eb35cfda1d362b60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:37:46.524953 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:46.525579 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d8487b14-0a44-4166-899d-24d88c68a769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:46.527138 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1319/2608] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:37:46 2022] DELETE /identity/v3/projects/04b4a7fdf932431eb35cfda1d362b60c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:46.532271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04f1e9-0539-4c19-b00b-075f566c0d1e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:46.532806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04f1e9-0539-4c19-b00b-075f566c0d1e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:46.532923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04f1e9-0539-4c19-b00b-075f566c0d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:46.553770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6d04f1e9-0539-4c19-b00b-075f566c0d1e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:46.555005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6d04f1e9-0539-4c19-b00b-075f566c0d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:46.603808 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:46.618847 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1290/2609] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:46.627076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f0284-180f-46e6-88f8-efdd1daaffa8 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:46.627448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f0284-180f-46e6-88f8-efdd1daaffa8 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:46.627780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f0284-180f-46e6-88f8-efdd1daaffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:46.649218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-845f0284-180f-46e6-88f8-efdd1daaffa8 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:46.650495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-845f0284-180f-46e6-88f8-efdd1daaffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:46.659586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1320/2610] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:46.664493 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04f1e9-0539-4c19-b00b-075f566c0d1e None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:46.675191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04f1e9-0539-4c19-b00b-075f566c0d1e None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:46.679939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267c4ba-9f77-4952-90c8-0181ac693515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:46.680571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267c4ba-9f77-4952-90c8-0181ac693515 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:46.680848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267c4ba-9f77-4952-90c8-0181ac693515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:46.681115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267c4ba-9f77-4952-90c8-0181ac693515 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:46.681755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267c4ba-9f77-4952-90c8-0181ac693515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:37:46.682052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267c4ba-9f77-4952-90c8-0181ac693515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:46.683646 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267c4ba-9f77-4952-90c8-0181ac693515 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:46.701571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1291/2611] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:37:46.705275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f0284-180f-46e6-88f8-efdd1daaffa8 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:46.710380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f0284-180f-46e6-88f8-efdd1daaffa8 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:46.717318 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba22177-3f83-45b7-837b-7f9d40bccfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:46.718303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba22177-3f83-45b7-837b-7f9d40bccfcc admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:46.718993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba22177-3f83-45b7-837b-7f9d40bccfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:46.719551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba22177-3f83-45b7-837b-7f9d40bccfcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:46.721950 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba22177-3f83-45b7-837b-7f9d40bccfcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:46.724077 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba22177-3f83-45b7-837b-7f9d40bccfcc admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:46.731211 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:46.770647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1321/2612] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:37:46 2022] POST /identity/v3/projects => generated 399 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:46.775039 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267c4ba-9f77-4952-90c8-0181ac693515 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:46.785217 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267c4ba-9f77-4952-90c8-0181ac693515 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:46.849006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a61d3-a6b8-4c6e-a08f-61eb3fe63266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:46.849658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a61d3-a6b8-4c6e-a08f-61eb3fe63266 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:46.849930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a61d3-a6b8-4c6e-a08f-61eb3fe63266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:46.850196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a61d3-a6b8-4c6e-a08f-61eb3fe63266 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:46.850816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a61d3-a6b8-4c6e-a08f-61eb3fe63266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:46.852774 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a61d3-a6b8-4c6e-a08f-61eb3fe63266 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:46.876987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1292/2613] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:37:46 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:46.881410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba22177-3f83-45b7-837b-7f9d40bccfcc admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:46.892501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba22177-3f83-45b7-837b-7f9d40bccfcc admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:46.898446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81596c9d-0263-4460-90ea-d1f480fa3769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:46.899048 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596c9d-0263-4460-90ea-d1f480fa3769 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:46.899450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596c9d-0263-4460-90ea-d1f480fa3769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:46.899696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596c9d-0263-4460-90ea-d1f480fa3769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:46.900342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81596c9d-0263-4460-90ea-d1f480fa3769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:46.902090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81596c9d-0263-4460-90ea-d1f480fa3769 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:46.912857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1322/2614] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:46.917216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a61d3-a6b8-4c6e-a08f-61eb3fe63266 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:46.927952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a61d3-a6b8-4c6e-a08f-61eb3fe63266 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:46.933040 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f7e3-cd34-4aaf-969b-62e7290f8f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:46.933620 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f7e3-cd34-4aaf-969b-62e7290f8f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:46.933894 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f7e3-cd34-4aaf-969b-62e7290f8f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:46.934191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f7e3-cd34-4aaf-969b-62e7290f8f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:46.934867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232f7e3-cd34-4aaf-969b-62e7290f8f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:46.936511 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232f7e3-cd34-4aaf-969b-62e7290f8f9a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:46.947291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1293/2615] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:46.951798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81596c9d-0263-4460-90ea-d1f480fa3769 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:46.962809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81596c9d-0263-4460-90ea-d1f480fa3769 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:46.968833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d67bf-f8fd-49aa-8938-f01a301ce437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:46.969483 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d67bf-f8fd-49aa-8938-f01a301ce437 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:46.969882 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d67bf-f8fd-49aa-8938-f01a301ce437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:46.970202 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d67bf-f8fd-49aa-8938-f01a301ce437 admin admin] PATH_INFO: `/v3/projects/05dbb19a2c3a4f47ae67d23b7a1a1a50/users/97da9dff7db9479a9e75d4a87b8c3958/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:46.985764 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d67bf-f8fd-49aa-8938-f01a301ce437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05dbb19a2c3a4f47ae67d23b7a1a1a50, user_id=97da9dff7db9479a9e75d4a87b8c3958, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:46.988508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d67bf-f8fd-49aa-8938-f01a301ce437 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:47.003935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1323/2616] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:37:46 2022] PUT /identity/v3/projects/05dbb19a2c3a4f47ae67d23b7a1a1a50/users/97da9dff7db9479a9e75d4a87b8c3958/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:47.015889 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243a05-dce6-4a27-ad6b-a5738f7eea50 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:47.016173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243a05-dce6-4a27-ad6b-a5738f7eea50 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:47.016440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243a05-dce6-4a27-ad6b-a5738f7eea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:47.053044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e9243a05-dce6-4a27-ad6b-a5738f7eea50 None None] MFA Rules not processed for user `97da9dff7db9479a9e75d4a87b8c3958`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:47.054718 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e9243a05-dce6-4a27-ad6b-a5738f7eea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:47.124050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1294/2617] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:47.128969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d67bf-f8fd-49aa-8938-f01a301ce437 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:47.196136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d67bf-f8fd-49aa-8938-f01a301ce437 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:47.202592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa74ed-32b8-41cb-9298-85ebd7aa2267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:47.203204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa74ed-32b8-41cb-9298-85ebd7aa2267 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:47.203483 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa74ed-32b8-41cb-9298-85ebd7aa2267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:47.203745 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa74ed-32b8-41cb-9298-85ebd7aa2267 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:47.204378 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa74ed-32b8-41cb-9298-85ebd7aa2267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:47.206364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa74ed-32b8-41cb-9298-85ebd7aa2267 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:47.238081 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1324/2618] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:37:47 2022] POST /identity/v3/projects => generated 401 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:47.244619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9243a05-dce6-4a27-ad6b-a5738f7eea50 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:47.256994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9243a05-dce6-4a27-ad6b-a5738f7eea50 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:47.301697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:47.321386 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019130a-f901-44f7-b473-68ce5fc55e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:47.322271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019130a-f901-44f7-b473-68ce5fc55e22 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:47.322666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019130a-f901-44f7-b473-68ce5fc55e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:47.323052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019130a-f901-44f7-b473-68ce5fc55e22 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:47.323954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019130a-f901-44f7-b473-68ce5fc55e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:47.326448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019130a-f901-44f7-b473-68ce5fc55e22 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:47.350423 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1295/2619] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:37:47 2022] POST /identity/v3/users => generated 307 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:47.354588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa74ed-32b8-41cb-9298-85ebd7aa2267 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:47.365921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa74ed-32b8-41cb-9298-85ebd7aa2267 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:47.371445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c611ff-8826-43b5-ba78-aa68b3f93be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:47.372073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c611ff-8826-43b5-ba78-aa68b3f93be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:47.372323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c611ff-8826-43b5-ba78-aa68b3f93be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:47.372694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c611ff-8826-43b5-ba78-aa68b3f93be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:47.373347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c611ff-8826-43b5-ba78-aa68b3f93be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:47.375018 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c611ff-8826-43b5-ba78-aa68b3f93be7 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:47.385959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1325/2620] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:47.390379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019130a-f901-44f7-b473-68ce5fc55e22 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:47.401012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019130a-f901-44f7-b473-68ce5fc55e22 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:47.406527 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361f977-c664-4d5b-96b4-cde8b8cb4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:47.407196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361f977-c664-4d5b-96b4-cde8b8cb4bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:47.407477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361f977-c664-4d5b-96b4-cde8b8cb4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:47.407754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361f977-c664-4d5b-96b4-cde8b8cb4bc4 admin admin] PATH_INFO: `/v3/projects/f409c5ff3cbb40d6be8a335063066713/users/26787afd93604e8388421b042161202a/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:47.423233 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361f977-c664-4d5b-96b4-cde8b8cb4bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f409c5ff3cbb40d6be8a335063066713, user_id=26787afd93604e8388421b042161202a, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:47.425962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361f977-c664-4d5b-96b4-cde8b8cb4bc4 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:47.442234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1296/2621] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:37:47 2022] PUT /identity/v3/projects/f409c5ff3cbb40d6be8a335063066713/users/26787afd93604e8388421b042161202a/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:47.446274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c611ff-8826-43b5-ba78-aa68b3f93be7 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:47.456763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c611ff-8826-43b5-ba78-aa68b3f93be7 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:47.514244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d045d-5e90-44c0-b833-b3d5ab59e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:47.514853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d045d-5e90-44c0-b833-b3d5ab59e631 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:47.515128 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d045d-5e90-44c0-b833-b3d5ab59e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:47.515399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d045d-5e90-44c0-b833-b3d5ab59e631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:47.516039 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d045d-5e90-44c0-b833-b3d5ab59e631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:47.517684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d045d-5e90-44c0-b833-b3d5ab59e631 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:47.527390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1326/2622] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:47.533550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361f977-c664-4d5b-96b4-cde8b8cb4bc4 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:47.544100 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361f977-c664-4d5b-96b4-cde8b8cb4bc4 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:47.549516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2e1b-dc0f-4d1c-bcc8-e9c660de2af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:47.550336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2e1b-dc0f-4d1c-bcc8-e9c660de2af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:47.550519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2e1b-dc0f-4d1c-bcc8-e9c660de2af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:47.550947 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2e1b-dc0f-4d1c-bcc8-e9c660de2af5 admin admin] PATH_INFO: `/v3/projects/f409c5ff3cbb40d6be8a335063066713/users/26787afd93604e8388421b042161202a/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:47.553005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe2e1b-dc0f-4d1c-bcc8-e9c660de2af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f409c5ff3cbb40d6be8a335063066713, user_id=26787afd93604e8388421b042161202a, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:47.555677 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe2e1b-dc0f-4d1c-bcc8-e9c660de2af5 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:47.566296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1297/2623] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:37:47 2022] PUT /identity/v3/projects/f409c5ff3cbb40d6be8a335063066713/users/26787afd93604e8388421b042161202a/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:47.577243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed23a8-4686-4c91-ab10-dc694dd41e84 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:47.577527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed23a8-4686-4c91-ab10-dc694dd41e84 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:47.577814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed23a8-4686-4c91-ab10-dc694dd41e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:47.607969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-26ed23a8-4686-4c91-ab10-dc694dd41e84 None None] MFA Rules not processed for user `26787afd93604e8388421b042161202a`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:47.609233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-26ed23a8-4686-4c91-ab10-dc694dd41e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:47.619337 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:47.682401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1327/2624] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:47 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:47.694722 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2e1b-dc0f-4d1c-bcc8-e9c660de2af5 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:47.696861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a8fe2e1b-dc0f-4d1c-bcc8-e9c660de2af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:47.756963 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2e1b-dc0f-4d1c-bcc8-e9c660de2af5 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:47.760985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14903-e605-49e0-8f15-2d14f0e62949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:47.761598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14903-e605-49e0-8f15-2d14f0e62949 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:47.761896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14903-e605-49e0-8f15-2d14f0e62949 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:47.762149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14903-e605-49e0-8f15-2d14f0e62949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:47.772268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e14903-e605-49e0-8f15-2d14f0e62949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:47.773684 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e14903-e605-49e0-8f15-2d14f0e62949 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:47.784279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1298/2625] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:47 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:47.866721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed23a8-4686-4c91-ab10-dc694dd41e84 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:47.868305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-26ed23a8-4686-4c91-ab10-dc694dd41e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:47.886332 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed23a8-4686-4c91-ab10-dc694dd41e84 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:47.890237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d37e1-ee3c-4e0e-9eaa-4715cfb7ad62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:47.890861 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d37e1-ee3c-4e0e-9eaa-4715cfb7ad62 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:47.891214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d37e1-ee3c-4e0e-9eaa-4715cfb7ad62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:47.891382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d37e1-ee3c-4e0e-9eaa-4715cfb7ad62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:47.951519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d37e1-ee3c-4e0e-9eaa-4715cfb7ad62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:47.952966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d37e1-ee3c-4e0e-9eaa-4715cfb7ad62 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:47.962642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1328/2626] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:51.364425 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14903-e605-49e0-8f15-2d14f0e62949 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:51.366134 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-15e14903-e605-49e0-8f15-2d14f0e62949 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:51.436777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14903-e605-49e0-8f15-2d14f0e62949 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:51.443316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:51.443954 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:51.444229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:51.444537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] PATH_INFO: `/v3/users/2d0daefb622b4123a54a3837afd75b04` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:51.445778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0daefb622b4123a54a3837afd75b04)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:51.447909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:51.506652 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:51.509132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0daefb622b4123a54a3837afd75b04'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:51.510291 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0daefb622b4123a54a3837afd75b04'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:51.521813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0daefb622b4123a54a3837afd75b04'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:51.538885 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0daefb622b4123a54a3837afd75b04'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:51.539669 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0daefb622b4123a54a3837afd75b04'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:51.555914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1299/2627] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:37:51 2022] DELETE /identity/v3/users/2d0daefb622b4123a54a3837afd75b04 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:51.560884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f18df-3902-401f-ae93-5d1b136fd567 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:51.561446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f18df-3902-401f-ae93-5d1b136fd567 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:51.561446 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f18df-3902-401f-ae93-5d1b136fd567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:51.581275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-c76f18df-3902-401f-ae93-5d1b136fd567 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:51.582456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c76f18df-3902-401f-ae93-5d1b136fd567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:51.641559 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1329/2628] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:51.651417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:51.652951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:51.721487 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43662fc0-b8fe-420a-aa42-79c45e2501c1 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:51.725521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74cda3-6f5d-4cc2-bc9b-615e251d9733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:51.726155 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74cda3-6f5d-4cc2-bc9b-615e251d9733 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:51.726422 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74cda3-6f5d-4cc2-bc9b-615e251d9733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:51.726688 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74cda3-6f5d-4cc2-bc9b-615e251d9733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:51.735903 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74cda3-6f5d-4cc2-bc9b-615e251d9733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:51.737341 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74cda3-6f5d-4cc2-bc9b-615e251d9733 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:51.747112 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1300/2629] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:52.021910 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f18df-3902-401f-ae93-5d1b136fd567 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:52.023432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c76f18df-3902-401f-ae93-5d1b136fd567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:52.036633 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f18df-3902-401f-ae93-5d1b136fd567 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:52.042544 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:52.043325 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:52.043702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:52.044076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] PATH_INFO: `/v3/projects/c78573e04ec74240b397bdb167b5ec4c` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:52.045632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78573e04ec74240b397bdb167b5ec4c)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:52.048216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:52.094995 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:52.102757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78573e04ec74240b397bdb167b5ec4c', 'request_id': 'req-43ea2dad-fce9-4bb3-a776-ac72433cf79f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.110075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78573e04ec74240b397bdb167b5ec4c', 'request_id': 'req-43ea2dad-fce9-4bb3-a776-ac72433cf79f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.115945 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78573e04ec74240b397bdb167b5ec4c', 'request_id': 'req-43ea2dad-fce9-4bb3-a776-ac72433cf79f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.122019 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74cda3-6f5d-4cc2-bc9b-615e251d9733 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:52.123618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-bc74cda3-6f5d-4cc2-bc9b-615e251d9733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:52.131340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] The token cache is being invalidate because project c78573e04ec74240b397bdb167b5ec4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:37:52.131713 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.132588 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-43ea2dad-fce9-4bb3-a776-ac72433cf79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.134223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1330/2630] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:37:52 2022] DELETE /identity/v3/projects/c78573e04ec74240b397bdb167b5ec4c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:52.136951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74cda3-6f5d-4cc2-bc9b-615e251d9733 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:52.202058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:52.202726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:52.203013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:52.203295 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] PATH_INFO: `/v3/users/97da9dff7db9479a9e75d4a87b8c3958` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:52.204835 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97da9dff7db9479a9e75d4a87b8c3958)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:52.207007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:52.265206 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97da9dff7db9479a9e75d4a87b8c3958'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.265820 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97da9dff7db9479a9e75d4a87b8c3958'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.275267 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97da9dff7db9479a9e75d4a87b8c3958'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.285494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:52.292255 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97da9dff7db9479a9e75d4a87b8c3958'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.293192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97da9dff7db9479a9e75d4a87b8c3958'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.309433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1301/2631] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:37:52 2022] DELETE /identity/v3/users/97da9dff7db9479a9e75d4a87b8c3958 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:37:52.314331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8180e0-dd37-4bd9-96c2-26b984269256 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:52.314682 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8180e0-dd37-4bd9-96c2-26b984269256 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:52.314962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8180e0-dd37-4bd9-96c2-26b984269256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:52.337689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-2a8180e0-dd37-4bd9-96c2-26b984269256 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:52.338940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2a8180e0-dd37-4bd9-96c2-26b984269256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:52.403530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1331/2632] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:37:52.413802 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:52.415221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:52.472138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bbc59-53c6-4480-a9ec-0d8c635679c2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:52.475914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03a435-1837-4b21-919c-bffba429616e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:52.476551 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03a435-1837-4b21-919c-bffba429616e service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:52.476828 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03a435-1837-4b21-919c-bffba429616e service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:52.477097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03a435-1837-4b21-919c-bffba429616e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:52.486959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03a435-1837-4b21-919c-bffba429616e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:52.488433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03a435-1837-4b21-919c-bffba429616e service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:52.498496 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1302/2633] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:52.777511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8180e0-dd37-4bd9-96c2-26b984269256 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:52.779543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-2a8180e0-dd37-4bd9-96c2-26b984269256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:52.792269 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8180e0-dd37-4bd9-96c2-26b984269256 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:52.797692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:52.798428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:52.798920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:52.799227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] PATH_INFO: `/v3/projects/05dbb19a2c3a4f47ae67d23b7a1a1a50` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:52.800419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05dbb19a2c3a4f47ae67d23b7a1a1a50)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:52.802357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:52.852206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05dbb19a2c3a4f47ae67d23b7a1a1a50', 'request_id': 'req-778af2fe-822c-4075-aabd-e872b1d4b23f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.858562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05dbb19a2c3a4f47ae67d23b7a1a1a50', 'request_id': 'req-778af2fe-822c-4075-aabd-e872b1d4b23f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.864352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05dbb19a2c3a4f47ae67d23b7a1a1a50', 'request_id': 'req-778af2fe-822c-4075-aabd-e872b1d4b23f'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.879213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] The token cache is being invalidate because project 05dbb19a2c3a4f47ae67d23b7a1a1a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:37:52.879502 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.880163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:52.881701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1332/2634] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:37:52 2022] DELETE /identity/v3/projects/05dbb19a2c3a4f47ae67d23b7a1a1a50 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:52.885801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03a435-1837-4b21-919c-bffba429616e service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:52.895970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03a435-1837-4b21-919c-bffba429616e service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:52.952847 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:52.953479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:52.953755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:52.954052 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] PATH_INFO: `/v3/users/26787afd93604e8388421b042161202a` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:52.955357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26787afd93604e8388421b042161202a)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:52.957327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:53.008565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26787afd93604e8388421b042161202a'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:53.009231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26787afd93604e8388421b042161202a'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:53.016870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26787afd93604e8388421b042161202a'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:53.029696 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26787afd93604e8388421b042161202a'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:53.030382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-6f59b878-49f8-47b8-a6f5-b15cbd185201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26787afd93604e8388421b042161202a'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:53.045925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1303/2635] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:37:52 2022] DELETE /identity/v3/users/26787afd93604e8388421b042161202a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:53.347020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:53.348599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:53.363170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778af2fe-822c-4075-aabd-e872b1d4b23f admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:53.426774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:53.445750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:53.446756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:53.447168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:53.447827 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] PATH_INFO: `/v3/projects/f409c5ff3cbb40d6be8a335063066713` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:53.449927 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f409c5ff3cbb40d6be8a335063066713)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:53.453626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:53.510655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f409c5ff3cbb40d6be8a335063066713', 'request_id': 'req-416dc8d3-ae2b-45bb-8d37-81875b96ce70'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:53.520155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f409c5ff3cbb40d6be8a335063066713', 'request_id': 'req-416dc8d3-ae2b-45bb-8d37-81875b96ce70'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:53.526447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f409c5ff3cbb40d6be8a335063066713', 'request_id': 'req-416dc8d3-ae2b-45bb-8d37-81875b96ce70'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:53.541414 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] The token cache is being invalidate because project f409c5ff3cbb40d6be8a335063066713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:37:53.541698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:53.542339 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-416dc8d3-ae2b-45bb-8d37-81875b96ce70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:53.543867 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1333/2636] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:37:53 2022] DELETE /identity/v3/projects/f409c5ff3cbb40d6be8a335063066713 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:53.549015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1b12-2ca9-40f8-bcc5-0925f959deed None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:53.549631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1b12-2ca9-40f8-bcc5-0925f959deed None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:53.550018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1b12-2ca9-40f8-bcc5-0925f959deed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:53.563619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:53.570448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-5bdd1b12-2ca9-40f8-bcc5-0925f959deed None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:53.572285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5bdd1b12-2ca9-40f8-bcc5-0925f959deed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:53.638648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1304/2637] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:53.647761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05c63-e96a-4367-8221-5c6dbb9644ec None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:53.648055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05c63-e96a-4367-8221-5c6dbb9644ec None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:53.648329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05c63-e96a-4367-8221-5c6dbb9644ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:53.668858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-83f05c63-e96a-4367-8221-5c6dbb9644ec None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:53.670083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-83f05c63-e96a-4367-8221-5c6dbb9644ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:53.680607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1334/2638] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:53.686829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd1b12-2ca9-40f8-bcc5-0925f959deed None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:53.701157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd1b12-2ca9-40f8-bcc5-0925f959deed None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:53.708414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3be27e-11a6-4f13-9f62-33e8dc94434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:53.709451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be27e-11a6-4f13-9f62-33e8dc94434b admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:53.709924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be27e-11a6-4f13-9f62-33e8dc94434b admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:53.710381 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be27e-11a6-4f13-9f62-33e8dc94434b admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:53.711471 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3be27e-11a6-4f13-9f62-33e8dc94434b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:37:53.711995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3be27e-11a6-4f13-9f62-33e8dc94434b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:53.714038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3be27e-11a6-4f13-9f62-33e8dc94434b admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:53.729460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1305/2639] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:37:53.734465 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05c63-e96a-4367-8221-5c6dbb9644ec None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:53.745216 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05c63-e96a-4367-8221-5c6dbb9644ec None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:53.751070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4233e2-8d86-4f7b-916f-fa34afe7cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:53.751691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4233e2-8d86-4f7b-916f-fa34afe7cd40 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:53.751969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4233e2-8d86-4f7b-916f-fa34afe7cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:53.752242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4233e2-8d86-4f7b-916f-fa34afe7cd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:53.753012 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4233e2-8d86-4f7b-916f-fa34afe7cd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:53.754975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4233e2-8d86-4f7b-916f-fa34afe7cd40 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:53.785037 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1335/2640] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:37:53 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:53.789594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3be27e-11a6-4f13-9f62-33e8dc94434b admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:53.800465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3be27e-11a6-4f13-9f62-33e8dc94434b admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:53.871989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecddd8-863b-4023-b908-a45f307f2bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:53.872650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecddd8-863b-4023-b908-a45f307f2bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:53.872925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecddd8-863b-4023-b908-a45f307f2bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:53.873197 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecddd8-863b-4023-b908-a45f307f2bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:53.873833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecddd8-863b-4023-b908-a45f307f2bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:53.875782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecddd8-863b-4023-b908-a45f307f2bc6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:53.898608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1306/2641] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:37:53 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:53.902813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4233e2-8d86-4f7b-916f-fa34afe7cd40 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:53.913791 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4233e2-8d86-4f7b-916f-fa34afe7cd40 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:53.919692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5efb32-566d-494f-b93f-71c384168c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:53.920533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5efb32-566d-494f-b93f-71c384168c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:53.920805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5efb32-566d-494f-b93f-71c384168c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:53.921073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5efb32-566d-494f-b93f-71c384168c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:53.921760 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5efb32-566d-494f-b93f-71c384168c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:53.923708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5efb32-566d-494f-b93f-71c384168c7e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:53.935962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1336/2642] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:53.940161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecddd8-863b-4023-b908-a45f307f2bc6 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:53.950753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecddd8-863b-4023-b908-a45f307f2bc6 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:53.956976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3f69a-a58c-478c-a917-458e7d20772e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:53.957578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f69a-a58c-478c-a917-458e7d20772e admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:53.957848 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f69a-a58c-478c-a917-458e7d20772e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:53.958108 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f69a-a58c-478c-a917-458e7d20772e admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:53.958785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3f69a-a58c-478c-a917-458e7d20772e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:53.960423 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3f69a-a58c-478c-a917-458e7d20772e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:53.971678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1307/2643] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:37:53.976134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5efb32-566d-494f-b93f-71c384168c7e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:53.986630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5efb32-566d-494f-b93f-71c384168c7e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:53.991817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08566d83-d4bf-4f4b-9ee4-a84f7f621664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:53.992477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08566d83-d4bf-4f4b-9ee4-a84f7f621664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:53.992750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08566d83-d4bf-4f4b-9ee4-a84f7f621664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:53.993343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08566d83-d4bf-4f4b-9ee4-a84f7f621664 admin admin] PATH_INFO: `/v3/projects/8544bfa96a8c40bcb7ac77944bd9f40f/users/2343a7368f204b0781e46ab5630581d4/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:54.009260 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08566d83-d4bf-4f4b-9ee4-a84f7f621664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8544bfa96a8c40bcb7ac77944bd9f40f, user_id=2343a7368f204b0781e46ab5630581d4, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:54.011921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08566d83-d4bf-4f4b-9ee4-a84f7f621664 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:54.027224 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1337/2644] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:37:53 2022] PUT /identity/v3/projects/8544bfa96a8c40bcb7ac77944bd9f40f/users/2343a7368f204b0781e46ab5630581d4/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:54.037868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e27a9-7d9b-4c5f-b499-0d9aea2d2770 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:54.038156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e27a9-7d9b-4c5f-b499-0d9aea2d2770 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:54.038432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e27a9-7d9b-4c5f-b499-0d9aea2d2770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:54.068234 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-3e5e27a9-7d9b-4c5f-b499-0d9aea2d2770 None None] MFA Rules not processed for user `2343a7368f204b0781e46ab5630581d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:54.069477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3e5e27a9-7d9b-4c5f-b499-0d9aea2d2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:54.136760 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1308/2645] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:54.148307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08566d83-d4bf-4f4b-9ee4-a84f7f621664 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:54.150504 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-08566d83-d4bf-4f4b-9ee4-a84f7f621664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:54.210283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08566d83-d4bf-4f4b-9ee4-a84f7f621664 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:54.214340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9cbd9-ff4e-4a61-8e74-231e35b50d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:54.214947 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cbd9-ff4e-4a61-8e74-231e35b50d22 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:54.215222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cbd9-ff4e-4a61-8e74-231e35b50d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:54.215497 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cbd9-ff4e-4a61-8e74-231e35b50d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:54.224314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9cbd9-ff4e-4a61-8e74-231e35b50d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:54.225802 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9cbd9-ff4e-4a61-8e74-231e35b50d22 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:54.234895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1338/2646] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:57.356373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e27a9-7d9b-4c5f-b499-0d9aea2d2770 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:57.361572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:57.425824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e27a9-7d9b-4c5f-b499-0d9aea2d2770 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:57.430745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:57.431379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:57.431658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:57.431926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] PATH_INFO: `/v3/users/2343a7368f204b0781e46ab5630581d4` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:57.433069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2343a7368f204b0781e46ab5630581d4)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:57.434992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:57.488289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2343a7368f204b0781e46ab5630581d4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:57.489036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2343a7368f204b0781e46ab5630581d4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:57.496794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2343a7368f204b0781e46ab5630581d4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:57.509286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2343a7368f204b0781e46ab5630581d4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:57.509958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2343a7368f204b0781e46ab5630581d4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:57.526734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1309/2647] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:37:57 2022] DELETE /identity/v3/users/2343a7368f204b0781e46ab5630581d4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:57.531443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951283d-7f8b-431d-9d8f-38d528173963 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:57.531909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951283d-7f8b-431d-9d8f-38d528173963 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:57.532005 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951283d-7f8b-431d-9d8f-38d528173963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:57.552701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4951283d-7f8b-431d-9d8f-38d528173963 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:57.554695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4951283d-7f8b-431d-9d8f-38d528173963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:57.572419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:57.617346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1339/2648] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:37:57.631396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:57.633126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:57.691782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fb82d-1068-4d44-bfb4-a4e51c74d90d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:57.695546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037581-ee80-45f7-b1c6-44ad34e70016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:57.696145 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037581-ee80-45f7-b1c6-44ad34e70016 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:57.696417 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037581-ee80-45f7-b1c6-44ad34e70016 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:57.696713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037581-ee80-45f7-b1c6-44ad34e70016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:57.707061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82037581-ee80-45f7-b1c6-44ad34e70016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:57.708668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82037581-ee80-45f7-b1c6-44ad34e70016 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:57.719128 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1310/2649] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:57.999681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951283d-7f8b-431d-9d8f-38d528173963 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:58.001142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4951283d-7f8b-431d-9d8f-38d528173963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:58.013473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951283d-7f8b-431d-9d8f-38d528173963 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:58.019529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:58.020294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.020696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.021072 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] PATH_INFO: `/v3/projects/8544bfa96a8c40bcb7ac77944bd9f40f` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.022570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8544bfa96a8c40bcb7ac77944bd9f40f)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:58.024616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:58.074602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8544bfa96a8c40bcb7ac77944bd9f40f', 'request_id': 'req-52f06558-eb85-4880-a371-b53d0e58e8cf'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:58.081073 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8544bfa96a8c40bcb7ac77944bd9f40f', 'request_id': 'req-52f06558-eb85-4880-a371-b53d0e58e8cf'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:58.088699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8544bfa96a8c40bcb7ac77944bd9f40f', 'request_id': 'req-52f06558-eb85-4880-a371-b53d0e58e8cf'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:58.104889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] The token cache is being invalidate because project 8544bfa96a8c40bcb7ac77944bd9f40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:37:58.105182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:58.105822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-52f06558-eb85-4880-a371-b53d0e58e8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:58.107383 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1340/2650] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:37:57 2022] DELETE /identity/v3/projects/8544bfa96a8c40bcb7ac77944bd9f40f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:58.112587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2338c0-a0d6-4582-a455-3cecd7980357 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.112892 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2338c0-a0d6-4582-a455-3cecd7980357 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.113192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2338c0-a0d6-4582-a455-3cecd7980357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.133870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-3a2338c0-a0d6-4582-a455-3cecd7980357 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:58.135057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3a2338c0-a0d6-4582-a455-3cecd7980357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:58.154784 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:58.197454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1311/2651] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:37:58.205732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70decf60-c8f5-4ff7-b6b8-dee694a1bd49 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.206020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70decf60-c8f5-4ff7-b6b8-dee694a1bd49 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.206289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70decf60-c8f5-4ff7-b6b8-dee694a1bd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.226136 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-70decf60-c8f5-4ff7-b6b8-dee694a1bd49 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:58.227330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-70decf60-c8f5-4ff7-b6b8-dee694a1bd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:58.235468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1341/2652] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:58.239836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2338c0-a0d6-4582-a455-3cecd7980357 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:58.250445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2338c0-a0d6-4582-a455-3cecd7980357 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:58.255899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4656a-6607-41e3-9a59-020307fb0efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:58.256500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4656a-6607-41e3-9a59-020307fb0efb admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.256866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4656a-6607-41e3-9a59-020307fb0efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.257136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4656a-6607-41e3-9a59-020307fb0efb admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.257798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4656a-6607-41e3-9a59-020307fb0efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:37:58.258113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4656a-6607-41e3-9a59-020307fb0efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:58.259750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4656a-6607-41e3-9a59-020307fb0efb admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:58.271723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1312/2653] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:37:58.276118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70decf60-c8f5-4ff7-b6b8-dee694a1bd49 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:58.285570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70decf60-c8f5-4ff7-b6b8-dee694a1bd49 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:58.290998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9404b3c-fd3c-4c9d-b3e9-498332e19584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:58.291599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404b3c-fd3c-4c9d-b3e9-498332e19584 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.291892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404b3c-fd3c-4c9d-b3e9-498332e19584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.292157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404b3c-fd3c-4c9d-b3e9-498332e19584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.292825 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9404b3c-fd3c-4c9d-b3e9-498332e19584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:58.294736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9404b3c-fd3c-4c9d-b3e9-498332e19584 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:58.324916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1342/2654] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:37:58 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:58.329337 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4656a-6607-41e3-9a59-020307fb0efb admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:58.340059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4656a-6607-41e3-9a59-020307fb0efb admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:58.400088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80ebee-4be7-46db-8101-27a57a1f6138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:58.400852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ebee-4be7-46db-8101-27a57a1f6138 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.401007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ebee-4be7-46db-8101-27a57a1f6138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.401282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ebee-4be7-46db-8101-27a57a1f6138 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.401920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80ebee-4be7-46db-8101-27a57a1f6138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:58.403873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80ebee-4be7-46db-8101-27a57a1f6138 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:58.426256 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1313/2655] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:37:58 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:37:58.430703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9404b3c-fd3c-4c9d-b3e9-498332e19584 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:58.441008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9404b3c-fd3c-4c9d-b3e9-498332e19584 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:58.446708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb370304-2729-4fcb-9e76-f93eb8dfd8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:58.447307 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb370304-2729-4fcb-9e76-f93eb8dfd8af admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.447581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb370304-2729-4fcb-9e76-f93eb8dfd8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.447847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb370304-2729-4fcb-9e76-f93eb8dfd8af admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.448531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb370304-2729-4fcb-9e76-f93eb8dfd8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:58.450140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb370304-2729-4fcb-9e76-f93eb8dfd8af admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:58.460520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1343/2656] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:58.464438 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80ebee-4be7-46db-8101-27a57a1f6138 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:58.475012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80ebee-4be7-46db-8101-27a57a1f6138 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:58.480248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6325f51-8831-4bc2-a3cc-c8685367cc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:58.480866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325f51-8831-4bc2-a3cc-c8685367cc56 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.481141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325f51-8831-4bc2-a3cc-c8685367cc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.481407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325f51-8831-4bc2-a3cc-c8685367cc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.482091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6325f51-8831-4bc2-a3cc-c8685367cc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:58.484414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6325f51-8831-4bc2-a3cc-c8685367cc56 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:58.498280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1314/2657] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:37:58.502716 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb370304-2729-4fcb-9e76-f93eb8dfd8af admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:58.513190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb370304-2729-4fcb-9e76-f93eb8dfd8af admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:58.518937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588b35-ffb3-4556-8b00-f0878cf45bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:58.519586 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588b35-ffb3-4556-8b00-f0878cf45bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.519856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588b35-ffb3-4556-8b00-f0878cf45bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.520121 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588b35-ffb3-4556-8b00-f0878cf45bbd admin admin] PATH_INFO: `/v3/projects/2014aef538f0488996587be909b61ab2/users/8da17a3622574eb2b656e33a5b3fd8a4/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.536474 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b588b35-ffb3-4556-8b00-f0878cf45bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2014aef538f0488996587be909b61ab2, user_id=8da17a3622574eb2b656e33a5b3fd8a4, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:58.539566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b588b35-ffb3-4556-8b00-f0878cf45bbd admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:58.557330 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1344/2658] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:37:58 2022] PUT /identity/v3/projects/2014aef538f0488996587be909b61ab2/users/8da17a3622574eb2b656e33a5b3fd8a4/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:37:58.562634 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7f7b5-10b7-4714-824b-4cfd790f2a12 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.562980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7f7b5-10b7-4714-824b-4cfd790f2a12 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.563262 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7f7b5-10b7-4714-824b-4cfd790f2a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.582980 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-72e7f7b5-10b7-4714-824b-4cfd790f2a12 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:58.584124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-72e7f7b5-10b7-4714-824b-4cfd790f2a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:58.648694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1315/2659] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:58.658706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588b35-ffb3-4556-8b00-f0878cf45bbd admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:58.660836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-5b588b35-ffb3-4556-8b00-f0878cf45bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:58.709646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:58.725957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588b35-ffb3-4556-8b00-f0878cf45bbd admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:58.732102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bf8c3-036d-40f8-b439-dd0f9f9bce05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:58.733061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bf8c3-036d-40f8-b439-dd0f9f9bce05 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:58.733473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bf8c3-036d-40f8-b439-dd0f9f9bce05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:58.733885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bf8c3-036d-40f8-b439-dd0f9f9bce05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:58.747390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bf8c3-036d-40f8-b439-dd0f9f9bce05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:58.748871 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bf8c3-036d-40f8-b439-dd0f9f9bce05 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:58.758907 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1345/2660] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:37:59.417403 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d957150-f594-4d80-a03d-4968030e4318 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:59.418017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d957150-f594-4d80-a03d-4968030e4318 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:59.418017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d957150-f594-4d80-a03d-4968030e4318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:59.447967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-5d957150-f594-4d80-a03d-4968030e4318 None None] MFA Rules not processed for user `8da17a3622574eb2b656e33a5b3fd8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:37:59.449251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5d957150-f594-4d80-a03d-4968030e4318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:59.469794 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:59.535710 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1316/2661] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:37:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:37:59.547346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bf8c3-036d-40f8-b439-dd0f9f9bce05 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:59.549214 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-aa5bf8c3-036d-40f8-b439-dd0f9f9bce05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:37:59.615486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bf8c3-036d-40f8-b439-dd0f9f9bce05 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:59.619349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca55df5-7911-438a-b84a-cdeca991ac1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:59.620303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca55df5-7911-438a-b84a-cdeca991ac1a service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:59.620632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca55df5-7911-438a-b84a-cdeca991ac1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:59.620886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca55df5-7911-438a-b84a-cdeca991ac1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:59.630133 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca55df5-7911-438a-b84a-cdeca991ac1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:59.631597 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca55df5-7911-438a-b84a-cdeca991ac1a service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:59.642243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1346/2662] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:37:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:38:01.035149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc06a4a-d896-4c5e-b459-942c88b61e9e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:01.035701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc06a4a-d896-4c5e-b459-942c88b61e9e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:01.035701 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc06a4a-d896-4c5e-b459-942c88b61e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:01.186832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-7fc06a4a-d896-4c5e-b459-942c88b61e9e None None] MFA Rules not processed for user `8da17a3622574eb2b656e33a5b3fd8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:38:01.188042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7fc06a4a-d896-4c5e-b459-942c88b61e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:01.195770 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1317/2663] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:38:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:38:04.288215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca55df5-7911-438a-b84a-cdeca991ac1a service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:04.290020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9ca55df5-7911-438a-b84a-cdeca991ac1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:04.304175 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca55df5-7911-438a-b84a-cdeca991ac1a service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:04.308775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1f32-b565-44ab-99c5-43f5276ed5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:04.309387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1f32-b565-44ab-99c5-43f5276ed5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:04.309660 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1f32-b565-44ab-99c5-43f5276ed5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:04.309924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1f32-b565-44ab-99c5-43f5276ed5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:04.311879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b11f1f32-b565-44ab-99c5-43f5276ed5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:04.321744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f1f32-b565-44ab-99c5-43f5276ed5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:04.323297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f1f32-b565-44ab-99c5-43f5276ed5e8 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:04.331904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1347/2664] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:38:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:38:11.051592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=21 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:38:14.328049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=39 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:38:16.962127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddf063-3121-4610-bf02-a193f970af90 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:16.962657 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddf063-3121-4610-bf02-a193f970af90 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:16.962657 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddf063-3121-4610-bf02-a193f970af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:16.982815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-79ddf063-3121-4610-bf02-a193f970af90 None None] MFA Rules not processed for user `8da17a3622574eb2b656e33a5b3fd8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:38:16.984017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-79ddf063-3121-4610-bf02-a193f970af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:16.991719 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1318/2665] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:38:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:38:20.674703 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1f32-b565-44ab-99c5-43f5276ed5e8 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:20.676917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-b11f1f32-b565-44ab-99c5-43f5276ed5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:20.764331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1f32-b565-44ab-99c5-43f5276ed5e8 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:20.772597 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a29317-c441-41f7-a4ee-8b3cb54da74d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:20.773262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a29317-c441-41f7-a4ee-8b3cb54da74d service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:20.773543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a29317-c441-41f7-a4ee-8b3cb54da74d service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:20.773817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a29317-c441-41f7-a4ee-8b3cb54da74d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:20.775701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-05a29317-c441-41f7-a4ee-8b3cb54da74d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:20.788267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a29317-c441-41f7-a4ee-8b3cb54da74d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:20.789906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a29317-c441-41f7-a4ee-8b3cb54da74d service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:20.800510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1348/2666] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:38:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:38:23.622905 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa68b9-1629-45c7-b623-50d432769ee5 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:23.623495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa68b9-1629-45c7-b623-50d432769ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:23.623495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa68b9-1629-45c7-b623-50d432769ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:23.644524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-a1aa68b9-1629-45c7-b623-50d432769ee5 None None] MFA Rules not processed for user `2d7b54010888421484184e62dd07c258`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:38:23.645839 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a1aa68b9-1629-45c7-b623-50d432769ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:23.715190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1319/2667] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:38:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:38:26.448201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a29317-c441-41f7-a4ee-8b3cb54da74d service nova] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:26.463837 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a29317-c441-41f7-a4ee-8b3cb54da74d service nova] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:26.469796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2a8d7-efab-459a-a614-361c3a11d143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:26.470635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2a8d7-efab-459a-a614-361c3a11d143 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:26.470909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2a8d7-efab-459a-a614-361c3a11d143 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:26.471404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2a8d7-efab-459a-a614-361c3a11d143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:26.473905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cdb2a8d7-efab-459a-a614-361c3a11d143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:26.488686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2a8d7-efab-459a-a614-361c3a11d143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:26.490739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2a8d7-efab-459a-a614-361c3a11d143 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:26.518054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1349/2668] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:38:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:38:33.694919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=28 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:38:36.513080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=40 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:38:40.401945 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3833f-a638-403b-860a-6fbcfa3a4f4e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:40.402411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3833f-a638-403b-860a-6fbcfa3a4f4e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:40.402504 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3833f-a638-403b-860a-6fbcfa3a4f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:40.453325 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4dc3833f-a638-403b-860a-6fbcfa3a4f4e None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:38:40.454537 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4dc3833f-a638-403b-860a-6fbcfa3a4f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:40.534914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1320/2669] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:38:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:38:40.592364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2a8d7-efab-459a-a614-361c3a11d143 service nova] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:40.594412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cdb2a8d7-efab-459a-a614-361c3a11d143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:40.689748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2a8d7-efab-459a-a614-361c3a11d143 service nova] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:40.695916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90d0db-02f3-4366-9da3-233a1011dc93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:40.696568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90d0db-02f3-4366-9da3-233a1011dc93 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:40.696874 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90d0db-02f3-4366-9da3-233a1011dc93 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:40.697144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90d0db-02f3-4366-9da3-233a1011dc93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:40.706064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90d0db-02f3-4366-9da3-233a1011dc93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:40.707685 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90d0db-02f3-4366-9da3-233a1011dc93 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:40.716740 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1350/2670] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:38:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:38:50.531463 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=40 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:38:50.712777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=41 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:38:56.681874 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de981ad2-af9c-439b-bc38-472567ffb5d6 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:56.682368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de981ad2-af9c-439b-bc38-472567ffb5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:56.682368 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de981ad2-af9c-439b-bc38-472567ffb5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:56.701762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-de981ad2-af9c-439b-bc38-472567ffb5d6 None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:38:56.702957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-de981ad2-af9c-439b-bc38-472567ffb5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:56.710833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1321/2671] 10.222.0.49 () {58 vars in 967 bytes} [Fri Sep 16 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:38:56.723649 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90d0db-02f3-4366-9da3-233a1011dc93 service swift] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:56.734462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90d0db-02f3-4366-9da3-233a1011dc93 service swift] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:56.740198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586e663-e4c9-4930-bc2c-86bce00103af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:56.740832 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586e663-e4c9-4930-bc2c-86bce00103af service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:56.741107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586e663-e4c9-4930-bc2c-86bce00103af service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:56.741373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586e663-e4c9-4930-bc2c-86bce00103af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:56.749942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586e663-e4c9-4930-bc2c-86bce00103af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:56.751543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586e663-e4c9-4930-bc2c-86bce00103af service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:56.759852 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1351/2672] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:38:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:38:58.734627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de981ad2-af9c-439b-bc38-472567ffb5d6 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:58.747547 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de981ad2-af9c-439b-bc38-472567ffb5d6 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:58.753351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:58.753930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:58.754182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:58.754454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] PATH_INFO: `/v3/users/8da17a3622574eb2b656e33a5b3fd8a4` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:58.755743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da17a3622574eb2b656e33a5b3fd8a4)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:58.758479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:58.808852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da17a3622574eb2b656e33a5b3fd8a4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:38:58.809600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da17a3622574eb2b656e33a5b3fd8a4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:38:58.817237 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da17a3622574eb2b656e33a5b3fd8a4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:38:58.829899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da17a3622574eb2b656e33a5b3fd8a4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:38:58.830651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-854e0696-771c-4060-831e-97f33a231fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da17a3622574eb2b656e33a5b3fd8a4'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:38:58.845868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1322/2673] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:38:58 2022] DELETE /identity/v3/users/8da17a3622574eb2b656e33a5b3fd8a4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:38:59.026904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586e663-e4c9-4930-bc2c-86bce00103af service swift] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:59.037909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586e663-e4c9-4930-bc2c-86bce00103af service swift] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:59.096425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:59.097054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.097336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.097608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] PATH_INFO: `/v3/projects/2014aef538f0488996587be909b61ab2` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.098868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2014aef538f0488996587be909b61ab2)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:59.100879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:59.149475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2014aef538f0488996587be909b61ab2', 'request_id': 'req-f5afe4fb-27af-4007-9d33-e0d58d18a069'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:38:59.155854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2014aef538f0488996587be909b61ab2', 'request_id': 'req-f5afe4fb-27af-4007-9d33-e0d58d18a069'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:38:59.161809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2014aef538f0488996587be909b61ab2', 'request_id': 'req-f5afe4fb-27af-4007-9d33-e0d58d18a069'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:38:59.174027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] The token cache is being invalidate because project 2014aef538f0488996587be909b61ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:38:59.174316 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:38:59.174934 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f5afe4fb-27af-4007-9d33-e0d58d18a069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:38:59.176450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1352/2674] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:38:59 2022] DELETE /identity/v3/projects/2014aef538f0488996587be909b61ab2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:38:59.181618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441c0fd-e3e3-48fa-8f5f-2622f4e5cb53 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.181908 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441c0fd-e3e3-48fa-8f5f-2622f4e5cb53 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.182183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441c0fd-e3e3-48fa-8f5f-2622f4e5cb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.202757 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-6441c0fd-e3e3-48fa-8f5f-2622f4e5cb53 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:38:59.203972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-6441c0fd-e3e3-48fa-8f5f-2622f4e5cb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:59.269638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1323/2675] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:38:59.277714 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d5684-6456-4ce3-b8e5-14b56395701b None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.277999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d5684-6456-4ce3-b8e5-14b56395701b None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.278272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d5684-6456-4ce3-b8e5-14b56395701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.298810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-401d5684-6456-4ce3-b8e5-14b56395701b None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:38:59.300008 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-401d5684-6456-4ce3-b8e5-14b56395701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:59.309071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1353/2676] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:38:59.313532 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441c0fd-e3e3-48fa-8f5f-2622f4e5cb53 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:59.324563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441c0fd-e3e3-48fa-8f5f-2622f4e5cb53 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:59.329461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36c3ca-97a2-4b85-b6d8-ea4c4698616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:59.330056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c3ca-97a2-4b85-b6d8-ea4c4698616c admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.330327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c3ca-97a2-4b85-b6d8-ea4c4698616c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.330594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c3ca-97a2-4b85-b6d8-ea4c4698616c admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.331257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36c3ca-97a2-4b85-b6d8-ea4c4698616c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:38:59.331556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36c3ca-97a2-4b85-b6d8-ea4c4698616c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:59.333222 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36c3ca-97a2-4b85-b6d8-ea4c4698616c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:59.348112 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1324/2677] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:38:59.353689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d5684-6456-4ce3-b8e5-14b56395701b None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:59.363863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d5684-6456-4ce3-b8e5-14b56395701b None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:59.370257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ded8b-b107-41c9-94d5-c38746cd0e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:59.370856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ded8b-b107-41c9-94d5-c38746cd0e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.371125 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ded8b-b107-41c9-94d5-c38746cd0e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.371387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ded8b-b107-41c9-94d5-c38746cd0e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.372014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ded8b-b107-41c9-94d5-c38746cd0e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:59.373973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ded8b-b107-41c9-94d5-c38746cd0e15 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:59.405442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1354/2678] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:38:59 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:38:59.411706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36c3ca-97a2-4b85-b6d8-ea4c4698616c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:59.422097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36c3ca-97a2-4b85-b6d8-ea4c4698616c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:59.481898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:38:59.492862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713edc9-b93b-4f7e-b810-c80cfc5c7897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:59.493479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713edc9-b93b-4f7e-b810-c80cfc5c7897 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.493765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713edc9-b93b-4f7e-b810-c80cfc5c7897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.494364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713edc9-b93b-4f7e-b810-c80cfc5c7897 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.495004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713edc9-b93b-4f7e-b810-c80cfc5c7897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:59.496991 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713edc9-b93b-4f7e-b810-c80cfc5c7897 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:59.519844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1325/2679] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:38:59 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:38:59.525466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ded8b-b107-41c9-94d5-c38746cd0e15 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:59.535758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ded8b-b107-41c9-94d5-c38746cd0e15 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:59.541829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59bfba-56f9-4929-9371-4efcd2d21627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:59.542442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59bfba-56f9-4929-9371-4efcd2d21627 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.542717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59bfba-56f9-4929-9371-4efcd2d21627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.542984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59bfba-56f9-4929-9371-4efcd2d21627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.543632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59bfba-56f9-4929-9371-4efcd2d21627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:59.545294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59bfba-56f9-4929-9371-4efcd2d21627 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:59.556001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1355/2680] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:38:59.560477 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713edc9-b93b-4f7e-b810-c80cfc5c7897 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:59.571221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713edc9-b93b-4f7e-b810-c80cfc5c7897 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:59.576065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0cf01-98a7-4736-9497-4d16b8b363dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:59.576694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0cf01-98a7-4736-9497-4d16b8b363dd admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.576977 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0cf01-98a7-4736-9497-4d16b8b363dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.577250 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0cf01-98a7-4736-9497-4d16b8b363dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.577895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0cf01-98a7-4736-9497-4d16b8b363dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:59.579499 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0cf01-98a7-4736-9497-4d16b8b363dd admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:59.589837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1326/2681] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:38:59.594239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59bfba-56f9-4929-9371-4efcd2d21627 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:59.605046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59bfba-56f9-4929-9371-4efcd2d21627 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:59.611732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0108583-9549-49b0-bfc1-a5f33c306a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:59.613499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0108583-9549-49b0-bfc1-a5f33c306a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.613944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0108583-9549-49b0-bfc1-a5f33c306a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.614364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0108583-9549-49b0-bfc1-a5f33c306a99 admin admin] PATH_INFO: `/v3/projects/b9a06c927def46d5ac5747adf4a9dbaf/users/28d2de4306b64ca79d0128806bba0bfc/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.636239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0108583-9549-49b0-bfc1-a5f33c306a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a06c927def46d5ac5747adf4a9dbaf, user_id=28d2de4306b64ca79d0128806bba0bfc, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:59.641630 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0108583-9549-49b0-bfc1-a5f33c306a99 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:59.664981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1356/2682] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:38:59 2022] PUT /identity/v3/projects/b9a06c927def46d5ac5747adf4a9dbaf/users/28d2de4306b64ca79d0128806bba0bfc/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:38:59.681442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051a979-c947-4eac-a454-f6fcdc252a00 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.681732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051a979-c947-4eac-a454-f6fcdc252a00 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.682057 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051a979-c947-4eac-a454-f6fcdc252a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.711893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4051a979-c947-4eac-a454-f6fcdc252a00 None None] MFA Rules not processed for user `28d2de4306b64ca79d0128806bba0bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:38:59.713140 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4051a979-c947-4eac-a454-f6fcdc252a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:59.779724 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1327/2683] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:38:59.791342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0108583-9549-49b0-bfc1-a5f33c306a99 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:59.793135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e0108583-9549-49b0-bfc1-a5f33c306a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:38:59.808461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:38:59.852112 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0108583-9549-49b0-bfc1-a5f33c306a99 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:59.856165 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd637745-e0eb-44c6-be97-792be57b0434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:59.856800 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd637745-e0eb-44c6-be97-792be57b0434 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.857078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd637745-e0eb-44c6-be97-792be57b0434 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.857352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd637745-e0eb-44c6-be97-792be57b0434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.866203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd637745-e0eb-44c6-be97-792be57b0434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:59.867639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd637745-e0eb-44c6-be97-792be57b0434 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:38:59.877480 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1357/2684] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:38:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:38:59.903347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051a979-c947-4eac-a454-f6fcdc252a00 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:38:59.972990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051a979-c947-4eac-a454-f6fcdc252a00 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:38:59.979298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:38:59.979927 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:38:59.980207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:38:59.980536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] PATH_INFO: `/v3/users/28d2de4306b64ca79d0128806bba0bfc` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:38:59.981864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d2de4306b64ca79d0128806bba0bfc)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:38:59.984068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:00.040185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d2de4306b64ca79d0128806bba0bfc'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:00.041211 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d2de4306b64ca79d0128806bba0bfc'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:00.048882 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d2de4306b64ca79d0128806bba0bfc'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:00.054785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:39:00.063799 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d2de4306b64ca79d0128806bba0bfc'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:00.064772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d2de4306b64ca79d0128806bba0bfc'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:00.079244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1328/2685] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:38:59 2022] DELETE /identity/v3/users/28d2de4306b64ca79d0128806bba0bfc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:39:00.083822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f04e28-8a3a-47ff-ad70-564cb42a7487 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:00.084334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f04e28-8a3a-47ff-ad70-564cb42a7487 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:00.084467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f04e28-8a3a-47ff-ad70-564cb42a7487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:00.104706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-33f04e28-8a3a-47ff-ad70-564cb42a7487 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:00.105923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-33f04e28-8a3a-47ff-ad70-564cb42a7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:00.172568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1358/2686] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:00.185281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:00.186932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:00.246780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6599abc-970c-4134-bbe7-f79013ed41b2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:00.250698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf83a-157b-40f8-bc5c-4a8d647ae7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:00.251342 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf83a-157b-40f8-bc5c-4a8d647ae7fa service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:00.251651 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf83a-157b-40f8-bc5c-4a8d647ae7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:00.251917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf83a-157b-40f8-bc5c-4a8d647ae7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:00.264320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdf83a-157b-40f8-bc5c-4a8d647ae7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:00.266616 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdf83a-157b-40f8-bc5c-4a8d647ae7fa service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:00.281229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1329/2687] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:39:00.826591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f04e28-8a3a-47ff-ad70-564cb42a7487 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:00.828129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-33f04e28-8a3a-47ff-ad70-564cb42a7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:00.842192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f04e28-8a3a-47ff-ad70-564cb42a7487 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:00.848105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:00.849371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:00.849647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:00.850257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] PATH_INFO: `/v3/projects/b9a06c927def46d5ac5747adf4a9dbaf` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:00.851726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a06c927def46d5ac5747adf4a9dbaf)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:00.853643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:00.904502 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a06c927def46d5ac5747adf4a9dbaf', 'request_id': 'req-1b965984-0050-4406-a190-1d98df34043e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:00.910840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a06c927def46d5ac5747adf4a9dbaf', 'request_id': 'req-1b965984-0050-4406-a190-1d98df34043e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:00.916649 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a06c927def46d5ac5747adf4a9dbaf', 'request_id': 'req-1b965984-0050-4406-a190-1d98df34043e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:00.931976 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] The token cache is being invalidate because project b9a06c927def46d5ac5747adf4a9dbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:39:00.932262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:00.932998 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1b965984-0050-4406-a190-1d98df34043e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:00.934605 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1359/2688] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:39:00 2022] DELETE /identity/v3/projects/b9a06c927def46d5ac5747adf4a9dbaf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:39:00.939678 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db590dfa-4a85-4e32-a9b6-e23756caddd6 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:00.940213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db590dfa-4a85-4e32-a9b6-e23756caddd6 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:00.940213 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db590dfa-4a85-4e32-a9b6-e23756caddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:00.961339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-db590dfa-4a85-4e32-a9b6-e23756caddd6 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:00.962536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-db590dfa-4a85-4e32-a9b6-e23756caddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:01.029668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1330/2689] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:39:01.094699 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fe760-888b-45d4-a9dd-6fec5bb94010 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:01.095314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fe760-888b-45d4-a9dd-6fec5bb94010 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:01.095314 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fe760-888b-45d4-a9dd-6fec5bb94010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:01.116830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-103fe760-888b-45d4-a9dd-6fec5bb94010 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:01.117955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-103fe760-888b-45d4-a9dd-6fec5bb94010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:01.126466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1360/2690] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:01.131054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db590dfa-4a85-4e32-a9b6-e23756caddd6 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:01.144600 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db590dfa-4a85-4e32-a9b6-e23756caddd6 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:01.151253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02289eb-6911-42c9-844e-50ee84148f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:01.151856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02289eb-6911-42c9-844e-50ee84148f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:01.152150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02289eb-6911-42c9-844e-50ee84148f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:01.152407 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02289eb-6911-42c9-844e-50ee84148f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:01.153059 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02289eb-6911-42c9-844e-50ee84148f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:39:01.153416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02289eb-6911-42c9-844e-50ee84148f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:01.155001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02289eb-6911-42c9-844e-50ee84148f48 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:01.167870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1331/2691] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:39:01.172361 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fe760-888b-45d4-a9dd-6fec5bb94010 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:01.181949 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fe760-888b-45d4-a9dd-6fec5bb94010 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:01.187632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b1a75-a77e-4a54-b354-98635b84cac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:01.188225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b1a75-a77e-4a54-b354-98635b84cac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:01.188531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b1a75-a77e-4a54-b354-98635b84cac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:01.188803 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b1a75-a77e-4a54-b354-98635b84cac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:01.189445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b1a75-a77e-4a54-b354-98635b84cac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:01.191349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b1a75-a77e-4a54-b354-98635b84cac4 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:01.225659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1361/2692] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:39:01 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:39:01.229994 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02289eb-6911-42c9-844e-50ee84148f48 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:01.240286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02289eb-6911-42c9-844e-50ee84148f48 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:01.302652 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca02f2-1e1b-4ec6-941f-8f00d0e4ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:01.303256 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca02f2-1e1b-4ec6-941f-8f00d0e4ba11 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:01.303536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca02f2-1e1b-4ec6-941f-8f00d0e4ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:01.303806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca02f2-1e1b-4ec6-941f-8f00d0e4ba11 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:01.304570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca02f2-1e1b-4ec6-941f-8f00d0e4ba11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:01.306489 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca02f2-1e1b-4ec6-941f-8f00d0e4ba11 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:01.326092 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:39:01.334938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1332/2693] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:39:01 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:39:01.336308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b1a75-a77e-4a54-b354-98635b84cac4 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:01.346954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b1a75-a77e-4a54-b354-98635b84cac4 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:01.353134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3583-d4d4-4e93-ab66-c955194b7631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:01.353736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3583-d4d4-4e93-ab66-c955194b7631 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:01.354009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3583-d4d4-4e93-ab66-c955194b7631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:01.354254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3583-d4d4-4e93-ab66-c955194b7631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:01.354931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c3583-d4d4-4e93-ab66-c955194b7631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:01.356610 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c3583-d4d4-4e93-ab66-c955194b7631 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:01.362671 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:39:01.368263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1362/2694] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:39:01.372636 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca02f2-1e1b-4ec6-941f-8f00d0e4ba11 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:01.383653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca02f2-1e1b-4ec6-941f-8f00d0e4ba11 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:01.389811 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad3086-513a-49c1-b73d-c2f5bf63e56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:01.390430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3086-513a-49c1-b73d-c2f5bf63e56f admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:01.390706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3086-513a-49c1-b73d-c2f5bf63e56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:01.390978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3086-513a-49c1-b73d-c2f5bf63e56f admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:01.391627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3086-513a-49c1-b73d-c2f5bf63e56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:01.393308 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3086-513a-49c1-b73d-c2f5bf63e56f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:01.404563 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1333/2695] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:39:01.408879 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3583-d4d4-4e93-ab66-c955194b7631 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:01.419257 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3583-d4d4-4e93-ab66-c955194b7631 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:01.424261 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502974-ebad-4417-916d-748ce7c78201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:01.424944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502974-ebad-4417-916d-748ce7c78201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:01.425222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502974-ebad-4417-916d-748ce7c78201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:01.425481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502974-ebad-4417-916d-748ce7c78201 admin admin] PATH_INFO: `/v3/projects/0f1def6155e94f22b5648d9020375dd0/users/ba9746bb70c7466baee1bfbe998eae46/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:01.442041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5502974-ebad-4417-916d-748ce7c78201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1def6155e94f22b5648d9020375dd0, user_id=ba9746bb70c7466baee1bfbe998eae46, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:01.444827 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5502974-ebad-4417-916d-748ce7c78201 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:01.461438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1363/2696] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:39:01 2022] PUT /identity/v3/projects/0f1def6155e94f22b5648d9020375dd0/users/ba9746bb70c7466baee1bfbe998eae46/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:39:01.471518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e9a5a-659a-4b55-9393-acf991ae14aa None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:01.471801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e9a5a-659a-4b55-9393-acf991ae14aa None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:01.472068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e9a5a-659a-4b55-9393-acf991ae14aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:01.500990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f95e9a5a-659a-4b55-9393-acf991ae14aa None None] MFA Rules not processed for user `ba9746bb70c7466baee1bfbe998eae46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:01.502183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f95e9a5a-659a-4b55-9393-acf991ae14aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:01.574861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1334/2697] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:01.586155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502974-ebad-4417-916d-748ce7c78201 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:01.588074 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-a5502974-ebad-4417-916d-748ce7c78201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:01.646940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502974-ebad-4417-916d-748ce7c78201 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:01.651120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eaacc-3fa7-4980-852d-8754d1461834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:01.651727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eaacc-3fa7-4980-852d-8754d1461834 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:01.652006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eaacc-3fa7-4980-852d-8754d1461834 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:01.652274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eaacc-3fa7-4980-852d-8754d1461834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:01.661188 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eaacc-3fa7-4980-852d-8754d1461834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:01.662639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eaacc-3fa7-4980-852d-8754d1461834 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:01.671763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1364/2698] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:39:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:39:03.066640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419e3c6-3db9-490f-8939-2aa00fa18524 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:03.067226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419e3c6-3db9-490f-8939-2aa00fa18524 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:03.067226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419e3c6-3db9-490f-8939-2aa00fa18524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:03.093177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-5419e3c6-3db9-490f-8939-2aa00fa18524 None None] MFA Rules not processed for user `ba9746bb70c7466baee1bfbe998eae46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:03.094360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5419e3c6-3db9-490f-8939-2aa00fa18524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:03.103567 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1335/2699] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:03.597926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eaacc-3fa7-4980-852d-8754d1461834 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:03.599450 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-227eaacc-3fa7-4980-852d-8754d1461834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:03.675171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eaacc-3fa7-4980-852d-8754d1461834 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:03.681100 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14f61c-d44b-4217-9fb6-5d27fcb1cd68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:03.681704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f61c-d44b-4217-9fb6-5d27fcb1cd68 service placement] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:03.681978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f61c-d44b-4217-9fb6-5d27fcb1cd68 service placement] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:03.682256 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f61c-d44b-4217-9fb6-5d27fcb1cd68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:03.684002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9c14f61c-d44b-4217-9fb6-5d27fcb1cd68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:03.695204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14f61c-d44b-4217-9fb6-5d27fcb1cd68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:03.696905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14f61c-d44b-4217-9fb6-5d27fcb1cd68 service placement] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:03.707080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1365/2700] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:39:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:39:09.293320 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419e3c6-3db9-490f-8939-2aa00fa18524 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:09.294813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-5419e3c6-3db9-490f-8939-2aa00fa18524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:09.375184 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419e3c6-3db9-490f-8939-2aa00fa18524 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:09.381103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df0f7-1d0e-4b11-835e-fc93bafb6e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:09.381735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df0f7-1d0e-4b11-835e-fc93bafb6e87 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:09.382009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df0f7-1d0e-4b11-835e-fc93bafb6e87 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:09.382274 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df0f7-1d0e-4b11-835e-fc93bafb6e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:09.384044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d10df0f7-1d0e-4b11-835e-fc93bafb6e87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:09.399167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df0f7-1d0e-4b11-835e-fc93bafb6e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:09.400868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df0f7-1d0e-4b11-835e-fc93bafb6e87 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:09.412933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1336/2701] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:39:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:39:12.368277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291024-90e8-4bba-bbe2-23e944bc47b9 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:12.368826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291024-90e8-4bba-bbe2-23e944bc47b9 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:12.368826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291024-90e8-4bba-bbe2-23e944bc47b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:12.396234 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-55291024-90e8-4bba-bbe2-23e944bc47b9 None None] MFA Rules not processed for user `5c941c1962194ec79b18a0eaf98dc893`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:12.398154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-55291024-90e8-4bba-bbe2-23e944bc47b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:12.459335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1366/2702] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:19.408242 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=74 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:39:21.048922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ace652-63bd-4232-af98-e5780211418a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:21.049503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ace652-63bd-4232-af98-e5780211418a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:21.049503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ace652-63bd-4232-af98-e5780211418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:21.069899 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-85ace652-63bd-4232-af98-e5780211418a None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:21.071108 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-85ace652-63bd-4232-af98-e5780211418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:21.127062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1337/2703] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:39:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:39:21.139303 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55291024-90e8-4bba-bbe2-23e944bc47b9 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:21.140756 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-55291024-90e8-4bba-bbe2-23e944bc47b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:21.156520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:39:21.213619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55291024-90e8-4bba-bbe2-23e944bc47b9 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:21.220186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da947355-c05e-410b-8a6b-d185ae464782 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:21.221042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da947355-c05e-410b-8a6b-d185ae464782 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:21.221320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da947355-c05e-410b-8a6b-d185ae464782 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:21.221593 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da947355-c05e-410b-8a6b-d185ae464782 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:21.230403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da947355-c05e-410b-8a6b-d185ae464782 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:21.231958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da947355-c05e-410b-8a6b-d185ae464782 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:21.240096 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1367/2704] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:39:21.818085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38f58-a857-4b38-befa-b6569d7edcb0 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:21.818369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38f58-a857-4b38-befa-b6569d7edcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:21.818644 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38f58-a857-4b38-befa-b6569d7edcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:21.838412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-27a38f58-a857-4b38-befa-b6569d7edcb0 None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:21.839582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-27a38f58-a857-4b38-befa-b6569d7edcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:21.847306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1338/2705] 10.222.0.49 () {58 vars in 967 bytes} [Fri Sep 16 19:39:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:21.861955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da947355-c05e-410b-8a6b-d185ae464782 service swift] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:21.875249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da947355-c05e-410b-8a6b-d185ae464782 service swift] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:21.880513 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311df83a-f714-4f3a-b5b6-3fdae5abd022 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:21.881108 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311df83a-f714-4f3a-b5b6-3fdae5abd022 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:21.881403 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311df83a-f714-4f3a-b5b6-3fdae5abd022 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:21.881670 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311df83a-f714-4f3a-b5b6-3fdae5abd022 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:21.889456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311df83a-f714-4f3a-b5b6-3fdae5abd022 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:21.891041 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311df83a-f714-4f3a-b5b6-3fdae5abd022 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:21.899583 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1368/2706] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:39:22.162717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4eae-3755-4943-ac4f-80aa9ad60055 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:22.163254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4eae-3755-4943-ac4f-80aa9ad60055 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:22.163254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4eae-3755-4943-ac4f-80aa9ad60055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:22.183506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-4a6d4eae-3755-4943-ac4f-80aa9ad60055 None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:22.184743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4a6d4eae-3755-4943-ac4f-80aa9ad60055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:22.193253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1339/2707] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:39:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:22.205637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311df83a-f714-4f3a-b5b6-3fdae5abd022 service swift] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:22.216487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311df83a-f714-4f3a-b5b6-3fdae5abd022 service swift] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:22.221641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5baccc-158a-48ab-bacf-7d89997ddea4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:22.222234 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5baccc-158a-48ab-bacf-7d89997ddea4 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:22.222578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5baccc-158a-48ab-bacf-7d89997ddea4 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:22.222892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5baccc-158a-48ab-bacf-7d89997ddea4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:22.231141 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5baccc-158a-48ab-bacf-7d89997ddea4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:22.232761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5baccc-158a-48ab-bacf-7d89997ddea4 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:22.240750 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1369/2708] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:39:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:39:22.575115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7baba-f9ed-4ab5-95ed-19ab776388f2 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:22.575395 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7baba-f9ed-4ab5-95ed-19ab776388f2 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:22.575661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7baba-f9ed-4ab5-95ed-19ab776388f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:22.596264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-f5b7baba-f9ed-4ab5-95ed-19ab776388f2 None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:22.597485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f5b7baba-f9ed-4ab5-95ed-19ab776388f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:22.606082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1340/2709] 10.222.0.49 () {58 vars in 967 bytes} [Fri Sep 16 19:39:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:22.619395 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5baccc-158a-48ab-bacf-7d89997ddea4 service swift] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:22.630255 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5baccc-158a-48ab-bacf-7d89997ddea4 service swift] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:22.635473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471c57-5817-42a4-9682-3972af462ab0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:22.636084 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471c57-5817-42a4-9682-3972af462ab0 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:22.636364 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471c57-5817-42a4-9682-3972af462ab0 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:22.636662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471c57-5817-42a4-9682-3972af462ab0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:22.647170 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e471c57-5817-42a4-9682-3972af462ab0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:22.648814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e471c57-5817-42a4-9682-3972af462ab0 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:22.657428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1370/2710] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:39:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:39:24.846429 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7baba-f9ed-4ab5-95ed-19ab776388f2 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:24.914596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7baba-f9ed-4ab5-95ed-19ab776388f2 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:24.920533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:24.921174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:24.921453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:24.921721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] PATH_INFO: `/v3/users/ba9746bb70c7466baee1bfbe998eae46` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:24.922999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba9746bb70c7466baee1bfbe998eae46)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:24.924983 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:24.978344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba9746bb70c7466baee1bfbe998eae46'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:24.979028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba9746bb70c7466baee1bfbe998eae46'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:24.986571 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba9746bb70c7466baee1bfbe998eae46'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:24.999635 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba9746bb70c7466baee1bfbe998eae46'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:25.000351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba9746bb70c7466baee1bfbe998eae46'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:25.015897 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1341/2711] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:39:24 2022] DELETE /identity/v3/users/ba9746bb70c7466baee1bfbe998eae46 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:39:25.020778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360bdde-eb09-4418-95c1-2348359b4a0e None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.021286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360bdde-eb09-4418-95c1-2348359b4a0e None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.021663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360bdde-eb09-4418-95c1-2348359b4a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.041890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f360bdde-eb09-4418-95c1-2348359b4a0e None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:25.043205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f360bdde-eb09-4418-95c1-2348359b4a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:25.110320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1371/2712] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:25.120318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:25.121921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:25.128746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:39:25.181495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8a0dc-03a5-4466-9d74-f86516670948 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:25.185355 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19165820-e93c-4e5c-861e-36696742c2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:25.185978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19165820-e93c-4e5c-861e-36696742c2ab service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.186229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19165820-e93c-4e5c-861e-36696742c2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.186495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19165820-e93c-4e5c-861e-36696742c2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.195921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19165820-e93c-4e5c-861e-36696742c2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:25.197444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19165820-e93c-4e5c-861e-36696742c2ab service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:25.207159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1342/2713] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:39:25.393131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360bdde-eb09-4418-95c1-2348359b4a0e None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:25.394892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f360bdde-eb09-4418-95c1-2348359b4a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:25.407338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360bdde-eb09-4418-95c1-2348359b4a0e None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:25.412796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:25.413455 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.413723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.413996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] PATH_INFO: `/v3/projects/0f1def6155e94f22b5648d9020375dd0` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.415131 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1def6155e94f22b5648d9020375dd0)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:25.417346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:25.468655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1def6155e94f22b5648d9020375dd0', 'request_id': 'req-9052d2c4-f1af-4182-9435-fd6e40cd3315'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:25.475062 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1def6155e94f22b5648d9020375dd0', 'request_id': 'req-9052d2c4-f1af-4182-9435-fd6e40cd3315'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:25.479280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:39:25.481725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1def6155e94f22b5648d9020375dd0', 'request_id': 'req-9052d2c4-f1af-4182-9435-fd6e40cd3315'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:25.496812 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] The token cache is being invalidate because project 0f1def6155e94f22b5648d9020375dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:39:25.497083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:25.497692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9052d2c4-f1af-4182-9435-fd6e40cd3315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:39:25.499181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1372/2714] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:39:25 2022] DELETE /identity/v3/projects/0f1def6155e94f22b5648d9020375dd0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:39:25.504138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c427a7-e9e8-4852-9c1d-0ad860a9242d None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.504446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c427a7-e9e8-4852-9c1d-0ad860a9242d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.504740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c427a7-e9e8-4852-9c1d-0ad860a9242d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.526518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-41c427a7-e9e8-4852-9c1d-0ad860a9242d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:25.527731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-41c427a7-e9e8-4852-9c1d-0ad860a9242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:25.594064 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1343/2715] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:25.602530 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2c10-2bd9-42a1-a4d6-3eeca8aa7c0d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.602846 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2c10-2bd9-42a1-a4d6-3eeca8aa7c0d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.603157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2c10-2bd9-42a1-a4d6-3eeca8aa7c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.632280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6bef2c10-2bd9-42a1-a4d6-3eeca8aa7c0d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:25.633533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6bef2c10-2bd9-42a1-a4d6-3eeca8aa7c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:25.643209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1373/2716] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:25.647876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c427a7-e9e8-4852-9c1d-0ad860a9242d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:25.658170 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c427a7-e9e8-4852-9c1d-0ad860a9242d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:25.663883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e8eb4-0612-4e44-ac30-9c2ba95f6f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:25.664519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e8eb4-0612-4e44-ac30-9c2ba95f6f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.664795 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e8eb4-0612-4e44-ac30-9c2ba95f6f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.665035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e8eb4-0612-4e44-ac30-9c2ba95f6f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.665694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e8eb4-0612-4e44-ac30-9c2ba95f6f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:39:25.665993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e8eb4-0612-4e44-ac30-9c2ba95f6f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:25.667587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e8eb4-0612-4e44-ac30-9c2ba95f6f11 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:25.679513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1344/2717] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:39:25.683964 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef2c10-2bd9-42a1-a4d6-3eeca8aa7c0d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:25.693631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef2c10-2bd9-42a1-a4d6-3eeca8aa7c0d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:25.698857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89bfda-9144-45bd-8c6f-39d410df1570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:25.699448 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89bfda-9144-45bd-8c6f-39d410df1570 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.699723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89bfda-9144-45bd-8c6f-39d410df1570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.699987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89bfda-9144-45bd-8c6f-39d410df1570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.700631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89bfda-9144-45bd-8c6f-39d410df1570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:25.702587 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89bfda-9144-45bd-8c6f-39d410df1570 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:25.732948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1374/2718] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:39:25 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:39:25.737136 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e8eb4-0612-4e44-ac30-9c2ba95f6f11 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:25.747276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e8eb4-0612-4e44-ac30-9c2ba95f6f11 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:25.805717 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6e531-7197-4b76-b195-3c995ebc8eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:25.806398 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6e531-7197-4b76-b195-3c995ebc8eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.806659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6e531-7197-4b76-b195-3c995ebc8eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.806949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6e531-7197-4b76-b195-3c995ebc8eaa admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.807556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6e531-7197-4b76-b195-3c995ebc8eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:25.809511 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6e531-7197-4b76-b195-3c995ebc8eaa admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:25.832891 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1345/2719] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:39:25 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:39:25.837396 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89bfda-9144-45bd-8c6f-39d410df1570 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:25.847937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89bfda-9144-45bd-8c6f-39d410df1570 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:25.853059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb8d50-241c-4233-902e-ba206f766328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:25.853662 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb8d50-241c-4233-902e-ba206f766328 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.853940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb8d50-241c-4233-902e-ba206f766328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.854213 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb8d50-241c-4233-902e-ba206f766328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.854856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb8d50-241c-4233-902e-ba206f766328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:25.856508 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb8d50-241c-4233-902e-ba206f766328 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:25.866445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1375/2720] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:39:25.870478 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6e531-7197-4b76-b195-3c995ebc8eaa admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:25.881043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6e531-7197-4b76-b195-3c995ebc8eaa admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:25.885943 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deafc7-93f2-4aa9-bf86-c40a9c6da8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:25.886536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deafc7-93f2-4aa9-bf86-c40a9c6da8ce admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.886844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deafc7-93f2-4aa9-bf86-c40a9c6da8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.887097 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deafc7-93f2-4aa9-bf86-c40a9c6da8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.887741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87deafc7-93f2-4aa9-bf86-c40a9c6da8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:25.889363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87deafc7-93f2-4aa9-bf86-c40a9c6da8ce admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:25.900723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1346/2721] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:39:25.905233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb8d50-241c-4233-902e-ba206f766328 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:25.915839 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb8d50-241c-4233-902e-ba206f766328 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:25.920746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b10e-41b9-4899-9cad-afe873347158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:25.921400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b10e-41b9-4899-9cad-afe873347158 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.921679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b10e-41b9-4899-9cad-afe873347158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.921951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b10e-41b9-4899-9cad-afe873347158 admin admin] PATH_INFO: `/v3/projects/1b0318f1a663428f9d5d3b4dcb7fca87/users/bd6c729a6c6b4c7882589398f0ba43ce/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.937054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16b10e-41b9-4899-9cad-afe873347158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0318f1a663428f9d5d3b4dcb7fca87, user_id=bd6c729a6c6b4c7882589398f0ba43ce, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:25.939938 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16b10e-41b9-4899-9cad-afe873347158 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:25.954796 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1376/2722] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:39:25 2022] PUT /identity/v3/projects/1b0318f1a663428f9d5d3b4dcb7fca87/users/bd6c729a6c6b4c7882589398f0ba43ce/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:39:25.960023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fa757-d246-4789-8092-e5a581782782 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:25.960309 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fa757-d246-4789-8092-e5a581782782 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:25.960621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fa757-d246-4789-8092-e5a581782782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:25.980256 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-fd6fa757-d246-4789-8092-e5a581782782 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:25.981496 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-fd6fa757-d246-4789-8092-e5a581782782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:25.995140 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:39:26.050618 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1347/2723] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:26.060769 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b10e-41b9-4899-9cad-afe873347158 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:26.062679 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-bf16b10e-41b9-4899-9cad-afe873347158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:26.135575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b10e-41b9-4899-9cad-afe873347158 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:26.140263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e8937-084e-4327-b6f1-9035bf69cbc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:26.140901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e8937-084e-4327-b6f1-9035bf69cbc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:26.141193 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e8937-084e-4327-b6f1-9035bf69cbc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:26.141452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e8937-084e-4327-b6f1-9035bf69cbc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:26.151921 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e8937-084e-4327-b6f1-9035bf69cbc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:26.153391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e8937-084e-4327-b6f1-9035bf69cbc3 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:26.164134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1377/2724] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:39:26.820180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d71fdf-b707-4962-80e5-0e9592d7325e None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:26.820605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d71fdf-b707-4962-80e5-0e9592d7325e None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:26.820974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d71fdf-b707-4962-80e5-0e9592d7325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:26.848780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-d6d71fdf-b707-4962-80e5-0e9592d7325e None None] MFA Rules not processed for user `bd6c729a6c6b4c7882589398f0ba43ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:26.850294 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d6d71fdf-b707-4962-80e5-0e9592d7325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:26.919091 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1348/2725] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:26.931598 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e8937-084e-4327-b6f1-9035bf69cbc3 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:26.933021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-845e8937-084e-4327-b6f1-9035bf69cbc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:26.992620 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e8937-084e-4327-b6f1-9035bf69cbc3 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:26.996308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344095c-3874-495a-9c3d-b0fc7196079a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:26.996951 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344095c-3874-495a-9c3d-b0fc7196079a service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:26.997223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344095c-3874-495a-9c3d-b0fc7196079a service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:26.997490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344095c-3874-495a-9c3d-b0fc7196079a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:27.006264 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344095c-3874-495a-9c3d-b0fc7196079a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:27.007722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344095c-3874-495a-9c3d-b0fc7196079a service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:27.017185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1378/2726] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:39:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:39:28.405759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1ec1-67f5-41e5-86ba-54117f3f47e5 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:28.406322 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1ec1-67f5-41e5-86ba-54117f3f47e5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:28.406322 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1ec1-67f5-41e5-86ba-54117f3f47e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:28.426607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-905f1ec1-67f5-41e5-86ba-54117f3f47e5 None None] MFA Rules not processed for user `bd6c729a6c6b4c7882589398f0ba43ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:39:28.427809 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-905f1ec1-67f5-41e5-86ba-54117f3f47e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:28.435764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1349/2727] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:39:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:39:28.693233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344095c-3874-495a-9c3d-b0fc7196079a service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:28.694857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9344095c-3874-495a-9c3d-b0fc7196079a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:28.707297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344095c-3874-495a-9c3d-b0fc7196079a service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:28.711091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cc134-e031-40f1-97e2-0641362b2661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:28.711702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cc134-e031-40f1-97e2-0641362b2661 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:28.711972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cc134-e031-40f1-97e2-0641362b2661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:28.712242 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cc134-e031-40f1-97e2-0641362b2661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:28.713974 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-cc1cc134-e031-40f1-97e2-0641362b2661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:28.723854 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cc134-e031-40f1-97e2-0641362b2661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:28.725432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cc134-e031-40f1-97e2-0641362b2661 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:28.733486 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1379/2728] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:39:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:39:38.420867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=56 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:39:38.730142 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:DELETE=2,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:39:58.233893 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f1ec1-67f5-41e5-86ba-54117f3f47e5 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:39:58.236061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-905f1ec1-67f5-41e5-86ba-54117f3f47e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:58.313167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f1ec1-67f5-41e5-86ba-54117f3f47e5 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:39:58.319117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c92ac-422f-450f-808f-bfbf295838f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:39:58.319720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c92ac-422f-450f-808f-bfbf295838f7 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:39:58.320005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c92ac-422f-450f-808f-bfbf295838f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:39:58.320261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c92ac-422f-450f-808f-bfbf295838f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:39:58.322290 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-832c92ac-422f-450f-808f-bfbf295838f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:39:58.387043 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c92ac-422f-450f-808f-bfbf295838f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:39:58.388681 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c92ac-422f-450f-808f-bfbf295838f7 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:39:58.399115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1350/2729] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:39:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:40:08.394142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=56 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:40:30.821055 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9122ff2-2791-4c19-ab2b-2d25c0f6b68a None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:40:30.821602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9122ff2-2791-4c19-ab2b-2d25c0f6b68a None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:40:30.821602 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9122ff2-2791-4c19-ab2b-2d25c0f6b68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:40:30.841439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-f9122ff2-2791-4c19-ab2b-2d25c0f6b68a None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:40:30.843113 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f9122ff2-2791-4c19-ab2b-2d25c0f6b68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:40:30.908614 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1380/2730] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:40:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:40:30.963700 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c92ac-422f-450f-808f-bfbf295838f7 service nova] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:40:30.965193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-832c92ac-422f-450f-808f-bfbf295838f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:40:31.038923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c92ac-422f-450f-808f-bfbf295838f7 service nova] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:40:31.044861 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3356a92-e7e6-4abb-9219-13969f703350 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:40:31.045473 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356a92-e7e6-4abb-9219-13969f703350 service swift] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:40:31.045747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356a92-e7e6-4abb-9219-13969f703350 service swift] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:40:31.046015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356a92-e7e6-4abb-9219-13969f703350 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:40:31.058286 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3356a92-e7e6-4abb-9219-13969f703350 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:40:31.059876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3356a92-e7e6-4abb-9219-13969f703350 service swift] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:40:31.071430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1351/2731] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:40:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:40:38.994471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9122ff2-2791-4c19-ab2b-2d25c0f6b68a None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:40:38.996203 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-f9122ff2-2791-4c19-ab2b-2d25c0f6b68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:40:39.076462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9122ff2-2791-4c19-ab2b-2d25c0f6b68a None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:40:39.081514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e786b-4cb3-4590-83f7-527c01e45d71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:40:39.082262 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e786b-4cb3-4590-83f7-527c01e45d71 service placement] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:40:39.082761 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e786b-4cb3-4590-83f7-527c01e45d71 service placement] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:40:39.083531 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e786b-4cb3-4590-83f7-527c01e45d71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:40:39.085590 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3f1e786b-4cb3-4590-83f7-527c01e45d71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:40:39.097984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e786b-4cb3-4590-83f7-527c01e45d71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:40:39.100659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e786b-4cb3-4590-83f7-527c01e45d71 service placement] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:40:39.116652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1381/2732] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:40:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:40:41.065924 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=32 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:40:49.109554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=57 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:40:50.687960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b524d-fe4e-4e7e-9981-c665197ee019 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:40:50.688530 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b524d-fe4e-4e7e-9981-c665197ee019 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:40:50.688530 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b524d-fe4e-4e7e-9981-c665197ee019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:40:50.708810 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ef9b524d-fe4e-4e7e-9981-c665197ee019 None None] MFA Rules not processed for user `bd6c729a6c6b4c7882589398f0ba43ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:40:50.710029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ef9b524d-fe4e-4e7e-9981-c665197ee019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:40:50.718942 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1352/2733] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:40:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:40:50.978885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e786b-4cb3-4590-83f7-527c01e45d71 service placement] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:40:50.988708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e786b-4cb3-4590-83f7-527c01e45d71 service placement] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:40:50.992725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d65575-ed2b-49d3-a809-85e20a228420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:40:50.993321 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d65575-ed2b-49d3-a809-85e20a228420 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:40:50.993595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d65575-ed2b-49d3-a809-85e20a228420 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:40:50.993869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d65575-ed2b-49d3-a809-85e20a228420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:40:50.996444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c8d65575-ed2b-49d3-a809-85e20a228420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:40:51.006288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d65575-ed2b-49d3-a809-85e20a228420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:40:51.007717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d65575-ed2b-49d3-a809-85e20a228420 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:40:51.016677 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1382/2734] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:40:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:40:52.389347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b524d-fe4e-4e7e-9981-c665197ee019 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:40:52.402627 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b524d-fe4e-4e7e-9981-c665197ee019 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:40:52.407382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b9039-7945-4fab-9a4c-88813940ca82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:40:52.408552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b9039-7945-4fab-9a4c-88813940ca82 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:40:52.409444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b9039-7945-4fab-9a4c-88813940ca82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:40:52.409996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b9039-7945-4fab-9a4c-88813940ca82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:40:52.412313 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-eb9b9039-7945-4fab-9a4c-88813940ca82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:40:52.429176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b9039-7945-4fab-9a4c-88813940ca82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:40:52.431018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b9039-7945-4fab-9a4c-88813940ca82 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:40:52.443637 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1353/2735] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:40:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:40:52.614016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d65575-ed2b-49d3-a809-85e20a228420 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:40:52.627816 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d65575-ed2b-49d3-a809-85e20a228420 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:40:52.635258 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6921-d18b-4a10-8e11-45f916058b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:40:52.636615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6921-d18b-4a10-8e11-45f916058b7d service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:40:52.636902 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6921-d18b-4a10-8e11-45f916058b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:40:52.637176 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6921-d18b-4a10-8e11-45f916058b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:40:52.639188 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-912a6921-d18b-4a10-8e11-45f916058b7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:40:52.654290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a6921-d18b-4a10-8e11-45f916058b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:40:52.656640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a6921-d18b-4a10-8e11-45f916058b7d service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:40:52.668490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1383/2736] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:40:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:40:54.647185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c58b4-e5b5-4bbd-923f-0847d11fe727 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:40:54.647693 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c58b4-e5b5-4bbd-923f-0847d11fe727 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:40:54.647812 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c58b4-e5b5-4bbd-923f-0847d11fe727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:40:54.668479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-a95c58b4-e5b5-4bbd-923f-0847d11fe727 None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:40:54.670528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a95c58b4-e5b5-4bbd-923f-0847d11fe727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:40:54.677988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1354/2737] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:40:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:40:54.692840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6921-d18b-4a10-8e11-45f916058b7d service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:40:54.706161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6921-d18b-4a10-8e11-45f916058b7d service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:40:54.711543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc56142-7b54-4440-8ea7-5e91ef060920 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:40:54.712152 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc56142-7b54-4440-8ea7-5e91ef060920 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:40:54.712515 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc56142-7b54-4440-8ea7-5e91ef060920 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:40:54.713705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc56142-7b54-4440-8ea7-5e91ef060920 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:40:54.722426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc56142-7b54-4440-8ea7-5e91ef060920 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:40:54.724014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc56142-7b54-4440-8ea7-5e91ef060920 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:40:54.732297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1384/2738] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:41:04.662880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=12 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:41:04.728912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=18 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:41:18.103776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276d875-4829-4304-b7ab-65e17e64e8b7 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:41:18.104364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276d875-4829-4304-b7ab-65e17e64e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:41:18.104364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276d875-4829-4304-b7ab-65e17e64e8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:41:18.125619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-0276d875-4829-4304-b7ab-65e17e64e8b7 None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:41:18.126777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0276d875-4829-4304-b7ab-65e17e64e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:41:18.135559 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1355/2739] 10.222.0.49 () {58 vars in 967 bytes} [Fri Sep 16 19:41:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:41:18.149495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc56142-7b54-4440-8ea7-5e91ef060920 service swift] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:41:18.160737 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc56142-7b54-4440-8ea7-5e91ef060920 service swift] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:41:18.167316 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e30ea9-d66a-4f13-8dad-7cc15a7a1668 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:41:18.168317 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e30ea9-d66a-4f13-8dad-7cc15a7a1668 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:41:18.168907 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e30ea9-d66a-4f13-8dad-7cc15a7a1668 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:41:18.169344 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e30ea9-d66a-4f13-8dad-7cc15a7a1668 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:41:18.178137 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e30ea9-d66a-4f13-8dad-7cc15a7a1668 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:41:18.179734 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e30ea9-d66a-4f13-8dad-7cc15a7a1668 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:41:18.187687 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1385/2740] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:41:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:41:28.118985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:41:28.184975 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=6 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:41:48.619975 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276d875-4829-4304-b7ab-65e17e64e8b7 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:41:48.621330 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0276d875-4829-4304-b7ab-65e17e64e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:41:48.632917 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276d875-4829-4304-b7ab-65e17e64e8b7 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:41:48.636668 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887d3a3-ae2d-41c9-bf36-b35480f8bcc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:41:48.637229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887d3a3-ae2d-41c9-bf36-b35480f8bcc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:41:48.637490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887d3a3-ae2d-41c9-bf36-b35480f8bcc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:41:48.637785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887d3a3-ae2d-41c9-bf36-b35480f8bcc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:41:48.639476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3887d3a3-ae2d-41c9-bf36-b35480f8bcc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:41:48.703055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887d3a3-ae2d-41c9-bf36-b35480f8bcc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:41:48.705496 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887d3a3-ae2d-41c9-bf36-b35480f8bcc8 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:41:48.717993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1356/2741] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:41:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:41:58.713350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=28 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:04.025674 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3725-3ede-4045-9215-c3c5b3999ffa None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:04.026231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3725-3ede-4045-9215-c3c5b3999ffa None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:04.026475 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3725-3ede-4045-9215-c3c5b3999ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:04.054154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-21be3725-3ede-4045-9215-c3c5b3999ffa None None] MFA Rules not processed for user `5c941c1962194ec79b18a0eaf98dc893`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:42:04.056276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-21be3725-3ede-4045-9215-c3c5b3999ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:04.065523 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1386/2742] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:42:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:42:04.109138 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887d3a3-ae2d-41c9-bf36-b35480f8bcc8 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:04.118095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887d3a3-ae2d-41c9-bf36-b35480f8bcc8 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:04.121863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d1d24-4aa1-41f5-bbd8-904c01b8b0dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:04.122469 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d1d24-4aa1-41f5-bbd8-904c01b8b0dc service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:04.122747 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d1d24-4aa1-41f5-bbd8-904c01b8b0dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:04.123017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d1d24-4aa1-41f5-bbd8-904c01b8b0dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:04.124896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-151d1d24-4aa1-41f5-bbd8-904c01b8b0dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:04.138446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d1d24-4aa1-41f5-bbd8-904c01b8b0dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:04.139858 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d1d24-4aa1-41f5-bbd8-904c01b8b0dc service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:04.151382 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1357/2743] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:42:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:42:04.945746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3725-3ede-4045-9215-c3c5b3999ffa None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:04.956849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3725-3ede-4045-9215-c3c5b3999ffa None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:04.960904 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c17b1-6d4d-489e-89a1-7c502866ad20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:04.961884 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c17b1-6d4d-489e-89a1-7c502866ad20 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:04.962232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c17b1-6d4d-489e-89a1-7c502866ad20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:04.962576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c17b1-6d4d-489e-89a1-7c502866ad20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:04.964441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9b0c17b1-6d4d-489e-89a1-7c502866ad20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:04.979732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c17b1-6d4d-489e-89a1-7c502866ad20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:04.981292 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c17b1-6d4d-489e-89a1-7c502866ad20 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:04.994306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1387/2744] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:42:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:42:14.146193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=6 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:14.988715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=9 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:19.632282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d1d24-4aa1-41f5-bbd8-904c01b8b0dc service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:19.644451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d1d24-4aa1-41f5-bbd8-904c01b8b0dc service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:19.650451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92259d-b6d5-4b3d-99a1-3aa81dff742b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:19.651077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92259d-b6d5-4b3d-99a1-3aa81dff742b service placement] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:19.651354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92259d-b6d5-4b3d-99a1-3aa81dff742b service placement] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:19.651619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92259d-b6d5-4b3d-99a1-3aa81dff742b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:19.653622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-2c92259d-b6d5-4b3d-99a1-3aa81dff742b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:19.666297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92259d-b6d5-4b3d-99a1-3aa81dff742b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:19.667883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92259d-b6d5-4b3d-99a1-3aa81dff742b service placement] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:19.681890 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1358/2745] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:42:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:42:19.691896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c17b1-6d4d-489e-89a1-7c502866ad20 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:19.704926 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c17b1-6d4d-489e-89a1-7c502866ad20 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:19.709905 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:19.710592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:19.710870 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:19.711143 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] PATH_INFO: `/v3/users/bd6c729a6c6b4c7882589398f0ba43ce` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:19.712277 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd6c729a6c6b4c7882589398f0ba43ce)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:19.714425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:19.764844 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd6c729a6c6b4c7882589398f0ba43ce'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:19.765533 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd6c729a6c6b4c7882589398f0ba43ce'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:19.766157 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd6c729a6c6b4c7882589398f0ba43ce'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:19.773456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd6c729a6c6b4c7882589398f0ba43ce'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:19.786159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd6c729a6c6b4c7882589398f0ba43ce'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:19.802999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1388/2746] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:42:19 2022] DELETE /identity/v3/users/bd6c729a6c6b4c7882589398f0ba43ce => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:42:19.986414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92259d-b6d5-4b3d-99a1-3aa81dff742b service placement] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:19.998191 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92259d-b6d5-4b3d-99a1-3aa81dff742b service placement] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:20.058821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:20.059374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:20.059652 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:20.059923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] PATH_INFO: `/v3/projects/1b0318f1a663428f9d5d3b4dcb7fca87` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:20.061076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0318f1a663428f9d5d3b4dcb7fca87)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:20.063007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:20.114960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0318f1a663428f9d5d3b4dcb7fca87', 'request_id': 'req-690e6085-5bd7-4835-b24a-1551159d48b9'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:20.121503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0318f1a663428f9d5d3b4dcb7fca87', 'request_id': 'req-690e6085-5bd7-4835-b24a-1551159d48b9'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:20.131030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0318f1a663428f9d5d3b4dcb7fca87', 'request_id': 'req-690e6085-5bd7-4835-b24a-1551159d48b9'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:20.141666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] The token cache is being invalidate because project 1b0318f1a663428f9d5d3b4dcb7fca87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:42:20.141946 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:20.142594 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:20.144084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1359/2747] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:42:19 2022] DELETE /identity/v3/projects/1b0318f1a663428f9d5d3b4dcb7fca87 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:42:25.334683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:25.336281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:25.402158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c76ae9-428f-4549-9560-952801b7c79c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:25.452728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42e63-871a-4e2d-9a24-338c11a51f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:25.453336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42e63-871a-4e2d-9a24-338c11a51f1e service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:25.453611 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42e63-871a-4e2d-9a24-338c11a51f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:25.453873 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42e63-871a-4e2d-9a24-338c11a51f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:25.455706 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-71a42e63-871a-4e2d-9a24-338c11a51f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:25.501840 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:25.524293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a42e63-871a-4e2d-9a24-338c11a51f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:25.525784 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a42e63-871a-4e2d-9a24-338c11a51f1e service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:25.536596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1389/2748] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:42:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:42:30.138969 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:35.531270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=10 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:42.642207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:42.643898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:42.657465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e6085-5bd7-4835-b24a-1551159d48b9 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:42.661581 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769cd77-6d90-48d9-b612-ffd76ba26334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:42.662186 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769cd77-6d90-48d9-b612-ffd76ba26334 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:42.662465 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769cd77-6d90-48d9-b612-ffd76ba26334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:42.662738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769cd77-6d90-48d9-b612-ffd76ba26334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:42.664641 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8769cd77-6d90-48d9-b612-ffd76ba26334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:42.742519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769cd77-6d90-48d9-b612-ffd76ba26334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:42.744053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769cd77-6d90-48d9-b612-ffd76ba26334 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:42.754775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1360/2749] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:42:45.931758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42e63-871a-4e2d-9a24-338c11a51f1e service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:45.933302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-71a42e63-871a-4e2d-9a24-338c11a51f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:45.949495 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42e63-871a-4e2d-9a24-338c11a51f1e service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:45.957591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:45.958329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:45.958621 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:45.958895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] PATH_INFO: `/v3/users/2d7b54010888421484184e62dd07c258` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:45.960180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7b54010888421484184e62dd07c258)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:45.962221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:46.015333 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7b54010888421484184e62dd07c258'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:46.015988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7b54010888421484184e62dd07c258'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:46.017183 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7b54010888421484184e62dd07c258'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:46.024637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7b54010888421484184e62dd07c258'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:46.037095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-5945391b-5c1d-435e-b2ff-54c76f3ad16a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7b54010888421484184e62dd07c258'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:46.053931 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1390/2750] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:42:45 2022] DELETE /identity/v3/users/2d7b54010888421484184e62dd07c258 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:42:46.233521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769cd77-6d90-48d9-b612-ffd76ba26334 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:46.244307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769cd77-6d90-48d9-b612-ffd76ba26334 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:46.307084 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:46.307715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:46.307992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:46.308259 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] PATH_INFO: `/v3/projects/ea12091447ba4a5799d6f416b32fa5cc` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:46.309397 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea12091447ba4a5799d6f416b32fa5cc)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:46.311300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:46.361624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea12091447ba4a5799d6f416b32fa5cc', 'request_id': 'req-951ecada-cd26-44de-93b3-6ec808693d9e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:46.367797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea12091447ba4a5799d6f416b32fa5cc', 'request_id': 'req-951ecada-cd26-44de-93b3-6ec808693d9e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:46.376350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea12091447ba4a5799d6f416b32fa5cc', 'request_id': 'req-951ecada-cd26-44de-93b3-6ec808693d9e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:46.386315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] The token cache is being invalidate because project ea12091447ba4a5799d6f416b32fa5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:42:46.386573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:46.387193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-951ecada-cd26-44de-93b3-6ec808693d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:46.388730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1361/2751] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:42:46 2022] DELETE /identity/v3/projects/ea12091447ba4a5799d6f416b32fa5cc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:42:46.393942 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac462af-4c72-42da-aefc-b7feee72af8d None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:46.394222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac462af-4c72-42da-aefc-b7feee72af8d None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:46.394491 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac462af-4c72-42da-aefc-b7feee72af8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:46.414410 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-1ac462af-4c72-42da-aefc-b7feee72af8d None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:42:46.416248 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1ac462af-4c72-42da-aefc-b7feee72af8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:46.477966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1391/2752] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:42:46.486022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6cdf0-575a-480a-a4b0-befa1c4741d5 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:46.486303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6cdf0-575a-480a-a4b0-befa1c4741d5 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:46.486570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6cdf0-575a-480a-a4b0-befa1c4741d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:46.507776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-07d6cdf0-575a-480a-a4b0-befa1c4741d5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:42:46.509009 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-07d6cdf0-575a-480a-a4b0-befa1c4741d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:46.518444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1362/2753] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:42:46.522911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac462af-4c72-42da-aefc-b7feee72af8d None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:46.533393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac462af-4c72-42da-aefc-b7feee72af8d None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:46.538377 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c0d64-a6f3-46a7-a259-32d45fa83065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:46.538966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c0d64-a6f3-46a7-a259-32d45fa83065 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:46.539265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c0d64-a6f3-46a7-a259-32d45fa83065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:46.539548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c0d64-a6f3-46a7-a259-32d45fa83065 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:46.540182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c0d64-a6f3-46a7-a259-32d45fa83065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:42:46.540517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c0d64-a6f3-46a7-a259-32d45fa83065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:46.542109 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c0d64-a6f3-46a7-a259-32d45fa83065 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:46.554177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1392/2754] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:42:46.558752 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6cdf0-575a-480a-a4b0-befa1c4741d5 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:46.568354 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6cdf0-575a-480a-a4b0-befa1c4741d5 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:46.573491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454ff7e-79c7-48a3-bf7d-135071a9a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:46.574094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454ff7e-79c7-48a3-bf7d-135071a9a706 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:46.574357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454ff7e-79c7-48a3-bf7d-135071a9a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:46.574629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454ff7e-79c7-48a3-bf7d-135071a9a706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:46.575310 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454ff7e-79c7-48a3-bf7d-135071a9a706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:46.577334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454ff7e-79c7-48a3-bf7d-135071a9a706 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:46.594226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:46.608748 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1363/2755] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:42:46 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:42:46.613150 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c0d64-a6f3-46a7-a259-32d45fa83065 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:46.623231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c0d64-a6f3-46a7-a259-32d45fa83065 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:46.682979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbde11-31d3-4f0d-880a-5cc8a448939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:46.683499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbde11-31d3-4f0d-880a-5cc8a448939b admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:46.683772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbde11-31d3-4f0d-880a-5cc8a448939b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:46.684032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbde11-31d3-4f0d-880a-5cc8a448939b admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:46.684692 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbde11-31d3-4f0d-880a-5cc8a448939b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:46.686649 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbde11-31d3-4f0d-880a-5cc8a448939b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:46.694811 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:46.710704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1393/2756] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:42:46 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:42:46.714919 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454ff7e-79c7-48a3-bf7d-135071a9a706 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:46.725866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454ff7e-79c7-48a3-bf7d-135071a9a706 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:46.731536 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681f1c7-6efb-47e5-8301-e710774750bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:46.732175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f1c7-6efb-47e5-8301-e710774750bf admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:46.733301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f1c7-6efb-47e5-8301-e710774750bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:46.733596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f1c7-6efb-47e5-8301-e710774750bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:46.734292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681f1c7-6efb-47e5-8301-e710774750bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:46.735951 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681f1c7-6efb-47e5-8301-e710774750bf admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:46.746228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1364/2757] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:42:46.750417 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbde11-31d3-4f0d-880a-5cc8a448939b admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:46.760808 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbde11-31d3-4f0d-880a-5cc8a448939b admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:46.766441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc02ce-f2b5-44f3-8c7a-1c20e9bdf166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:46.767135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc02ce-f2b5-44f3-8c7a-1c20e9bdf166 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:46.767619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc02ce-f2b5-44f3-8c7a-1c20e9bdf166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:46.767973 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc02ce-f2b5-44f3-8c7a-1c20e9bdf166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:46.768730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc02ce-f2b5-44f3-8c7a-1c20e9bdf166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:46.770632 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc02ce-f2b5-44f3-8c7a-1c20e9bdf166 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:46.782952 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1394/2758] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:42:46.787346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681f1c7-6efb-47e5-8301-e710774750bf admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:46.798672 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681f1c7-6efb-47e5-8301-e710774750bf admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:46.803391 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249387-ef7c-4733-b53d-7f1d3a6ae3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:46.804056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249387-ef7c-4733-b53d-7f1d3a6ae3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:46.804338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249387-ef7c-4733-b53d-7f1d3a6ae3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:46.804658 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249387-ef7c-4733-b53d-7f1d3a6ae3cc admin admin] PATH_INFO: `/v3/projects/b47f3a28fa4f482ab604c23ef9b30386/users/b9775a6ea5ce41d3ac251169219d1510/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:46.819706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4249387-ef7c-4733-b53d-7f1d3a6ae3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47f3a28fa4f482ab604c23ef9b30386, user_id=b9775a6ea5ce41d3ac251169219d1510, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:46.822497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4249387-ef7c-4733-b53d-7f1d3a6ae3cc admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:46.836964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1365/2759] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:42:46 2022] PUT /identity/v3/projects/b47f3a28fa4f482ab604c23ef9b30386/users/b9775a6ea5ce41d3ac251169219d1510/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:42:46.847669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6a646-458f-4c2a-9fb9-3c5b5911bdb6 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:46.847959 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6a646-458f-4c2a-9fb9-3c5b5911bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:46.848229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6a646-458f-4c2a-9fb9-3c5b5911bdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:46.877728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-20d6a646-458f-4c2a-9fb9-3c5b5911bdb6 None None] MFA Rules not processed for user `b9775a6ea5ce41d3ac251169219d1510`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:42:46.879007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-20d6a646-458f-4c2a-9fb9-3c5b5911bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:46.944075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1395/2760] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:42:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:42:46.948751 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249387-ef7c-4733-b53d-7f1d3a6ae3cc admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:47.023185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249387-ef7c-4733-b53d-7f1d3a6ae3cc admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:47.028458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc127b21-1973-4c8a-a335-d35c0372874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:47.029095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc127b21-1973-4c8a-a335-d35c0372874e admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:47.029363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc127b21-1973-4c8a-a335-d35c0372874e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:47.029638 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc127b21-1973-4c8a-a335-d35c0372874e admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:47.030268 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc127b21-1973-4c8a-a335-d35c0372874e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:47.032283 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc127b21-1973-4c8a-a335-d35c0372874e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:47.064199 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1366/2761] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:42:46 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:42:47.068571 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6a646-458f-4c2a-9fb9-3c5b5911bdb6 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:47.079754 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6a646-458f-4c2a-9fb9-3c5b5911bdb6 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:47.147449 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5154de9-22cc-4848-92db-7f6c7ef2be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:47.148071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5154de9-22cc-4848-92db-7f6c7ef2be23 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:47.148348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5154de9-22cc-4848-92db-7f6c7ef2be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:47.148653 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5154de9-22cc-4848-92db-7f6c7ef2be23 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:47.149304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5154de9-22cc-4848-92db-7f6c7ef2be23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:47.151265 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5154de9-22cc-4848-92db-7f6c7ef2be23 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:47.176711 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1396/2762] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:42:47 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:42:47.181106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc127b21-1973-4c8a-a335-d35c0372874e admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:47.192755 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc127b21-1973-4c8a-a335-d35c0372874e admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:47.197904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa4394-75ad-491a-842b-81aacc0543eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:47.198438 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa4394-75ad-491a-842b-81aacc0543eb admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:47.198715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa4394-75ad-491a-842b-81aacc0543eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:47.198985 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa4394-75ad-491a-842b-81aacc0543eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:47.199629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa4394-75ad-491a-842b-81aacc0543eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:47.201271 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa4394-75ad-491a-842b-81aacc0543eb admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:47.212968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1367/2763] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:42:47.217323 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5154de9-22cc-4848-92db-7f6c7ef2be23 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:47.228049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5154de9-22cc-4848-92db-7f6c7ef2be23 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:47.234327 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a2906-81d3-4815-9979-64a4e6c59b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:47.234956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a2906-81d3-4815-9979-64a4e6c59b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:47.235228 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a2906-81d3-4815-9979-64a4e6c59b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:47.235522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a2906-81d3-4815-9979-64a4e6c59b83 admin admin] PATH_INFO: `/v3/projects/3fddd59663544fe19bee7cb182a997ff/users/6edff92cf8a540428d6cb89c0f088a7e/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:47.252347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a2906-81d3-4815-9979-64a4e6c59b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fddd59663544fe19bee7cb182a997ff, user_id=6edff92cf8a540428d6cb89c0f088a7e, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:47.255076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a2906-81d3-4815-9979-64a4e6c59b83 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:47.270592 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1397/2764] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:42:47 2022] PUT /identity/v3/projects/3fddd59663544fe19bee7cb182a997ff/users/6edff92cf8a540428d6cb89c0f088a7e/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:42:47.275029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa4394-75ad-491a-842b-81aacc0543eb admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:47.285490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa4394-75ad-491a-842b-81aacc0543eb admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:47.346159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbcda4-90cc-467f-a7e2-3ae45a9ff850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:47.346761 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbcda4-90cc-467f-a7e2-3ae45a9ff850 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:47.347041 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbcda4-90cc-467f-a7e2-3ae45a9ff850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:47.347312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbcda4-90cc-467f-a7e2-3ae45a9ff850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:47.347959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbcda4-90cc-467f-a7e2-3ae45a9ff850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:47.349591 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbcda4-90cc-467f-a7e2-3ae45a9ff850 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:47.359367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1368/2765] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:42:47.364042 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a2906-81d3-4815-9979-64a4e6c59b83 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:47.374968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a2906-81d3-4815-9979-64a4e6c59b83 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:47.380182 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989bcca-4624-4f77-8d81-de9a7775f840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:47.380886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989bcca-4624-4f77-8d81-de9a7775f840 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:47.381166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989bcca-4624-4f77-8d81-de9a7775f840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:47.381441 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989bcca-4624-4f77-8d81-de9a7775f840 admin admin] PATH_INFO: `/v3/projects/3fddd59663544fe19bee7cb182a997ff/users/6edff92cf8a540428d6cb89c0f088a7e/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:47.383422 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989bcca-4624-4f77-8d81-de9a7775f840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fddd59663544fe19bee7cb182a997ff, user_id=6edff92cf8a540428d6cb89c0f088a7e, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:47.386190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989bcca-4624-4f77-8d81-de9a7775f840 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:47.397201 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1398/2766] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:42:47 2022] PUT /identity/v3/projects/3fddd59663544fe19bee7cb182a997ff/users/6edff92cf8a540428d6cb89c0f088a7e/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:42:47.408992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d9ee4-e05d-431e-b487-98eab1d683af None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:47.409273 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d9ee4-e05d-431e-b487-98eab1d683af None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:47.409539 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d9ee4-e05d-431e-b487-98eab1d683af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:47.437926 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-0d0d9ee4-e05d-431e-b487-98eab1d683af None None] MFA Rules not processed for user `6edff92cf8a540428d6cb89c0f088a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:42:47.439261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0d0d9ee4-e05d-431e-b487-98eab1d683af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:47.459318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:47.514190 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1369/2767] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:42:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:42:47.526783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989bcca-4624-4f77-8d81-de9a7775f840 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:47.529016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7989bcca-4624-4f77-8d81-de9a7775f840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:47.553698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:47.599442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989bcca-4624-4f77-8d81-de9a7775f840 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:47.603489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bcd87-9c3c-4928-8171-4df5c740382f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:47.604134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bcd87-9c3c-4928-8171-4df5c740382f service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:47.604444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bcd87-9c3c-4928-8171-4df5c740382f service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:47.604707 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bcd87-9c3c-4928-8171-4df5c740382f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:47.614517 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bcd87-9c3c-4928-8171-4df5c740382f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:47.615972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bcd87-9c3c-4928-8171-4df5c740382f service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:47.625767 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1399/2768] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:42:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:42:47.706904 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d9ee4-e05d-431e-b487-98eab1d683af None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:47.717069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d9ee4-e05d-431e-b487-98eab1d683af None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:47.721231 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d00a5-8948-4088-8717-d1f1da80f8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:47.721813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d00a5-8948-4088-8717-d1f1da80f8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:47.722087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d00a5-8948-4088-8717-d1f1da80f8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:47.722350 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d00a5-8948-4088-8717-d1f1da80f8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:47.781346 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d00a5-8948-4088-8717-d1f1da80f8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:47.782884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d00a5-8948-4088-8717-d1f1da80f8d5 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:47.792751 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1370/2769] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:42:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:42:57.621304 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=17 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:57.788169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=48 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:42:59.581127 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bcd87-9c3c-4928-8171-4df5c740382f service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:59.648068 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bcd87-9c3c-4928-8171-4df5c740382f service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:59.653274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:59.653908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:59.654256 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:59.654437 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] PATH_INFO: `/v3/users/b9775a6ea5ce41d3ac251169219d1510` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:59.655681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9775a6ea5ce41d3ac251169219d1510)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:59.657680 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:59.716227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9775a6ea5ce41d3ac251169219d1510'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:59.716917 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9775a6ea5ce41d3ac251169219d1510'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:59.717535 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9775a6ea5ce41d3ac251169219d1510'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:59.724519 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9775a6ea5ce41d3ac251169219d1510'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:59.736469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9775a6ea5ce41d3ac251169219d1510'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:42:59.751204 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1400/2770] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:42:59 2022] DELETE /identity/v3/users/b9775a6ea5ce41d3ac251169219d1510 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:42:59.755860 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acc4c5-6aa7-426a-b7a1-ccdd2b7f4f41 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:59.756445 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acc4c5-6aa7-426a-b7a1-ccdd2b7f4f41 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:59.756605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acc4c5-6aa7-426a-b7a1-ccdd2b7f4f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:59.776754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-81acc4c5-6aa7-426a-b7a1-ccdd2b7f4f41 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:42:59.777949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-81acc4c5-6aa7-426a-b7a1-ccdd2b7f4f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:59.837625 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1371/2771] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:42:59.847540 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:42:59.849309 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:42:59.914683 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2da1b-4200-4bb7-ab19-7471e4839f43 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:42:59.918631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddeb5a5-c6c3-4154-b00c-582695e3f038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:42:59.919247 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddeb5a5-c6c3-4154-b00c-582695e3f038 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:42:59.919522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddeb5a5-c6c3-4154-b00c-582695e3f038 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:42:59.919805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddeb5a5-c6c3-4154-b00c-582695e3f038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:42:59.930061 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddeb5a5-c6c3-4154-b00c-582695e3f038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:42:59.931514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddeb5a5-c6c3-4154-b00c-582695e3f038 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:42:59.941197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1401/2772] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:00.222195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acc4c5-6aa7-426a-b7a1-ccdd2b7f4f41 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:00.223775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-81acc4c5-6aa7-426a-b7a1-ccdd2b7f4f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:00.237997 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acc4c5-6aa7-426a-b7a1-ccdd2b7f4f41 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:00.243195 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:00.243823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:00.244104 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:00.244376 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] PATH_INFO: `/v3/projects/b47f3a28fa4f482ab604c23ef9b30386` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:00.245596 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47f3a28fa4f482ab604c23ef9b30386)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:00.247583 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:00.302949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47f3a28fa4f482ab604c23ef9b30386', 'request_id': 'req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.309442 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47f3a28fa4f482ab604c23ef9b30386', 'request_id': 'req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.319490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47f3a28fa4f482ab604c23ef9b30386', 'request_id': 'req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.330179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] The token cache is being invalidate because project b47f3a28fa4f482ab604c23ef9b30386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:00.330464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.331144 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.332726 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1372/2773] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:00 2022] DELETE /identity/v3/projects/b47f3a28fa4f482ab604c23ef9b30386 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:00.337489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddeb5a5-c6c3-4154-b00c-582695e3f038 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:00.347343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddeb5a5-c6c3-4154-b00c-582695e3f038 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:00.366727 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:00.408810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:00.409454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:00.409736 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:00.410011 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] PATH_INFO: `/v3/users/6edff92cf8a540428d6cb89c0f088a7e` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:00.411163 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6edff92cf8a540428d6cb89c0f088a7e)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:00.413266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:00.465728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6edff92cf8a540428d6cb89c0f088a7e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.466334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6edff92cf8a540428d6cb89c0f088a7e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.466977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6edff92cf8a540428d6cb89c0f088a7e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.474223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6edff92cf8a540428d6cb89c0f088a7e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.486948 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-63d20a5a-70b8-44ff-8d74-ba2d5c720d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6edff92cf8a540428d6cb89c0f088a7e'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.501790 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1402/2774] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:00 2022] DELETE /identity/v3/users/6edff92cf8a540428d6cb89c0f088a7e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:00.778607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:00.780094 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:00.796790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21631b-ffe8-4b4e-b9ec-f394c2ae790e admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:00.858798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:00.859432 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:00.859713 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:00.859986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] PATH_INFO: `/v3/projects/3fddd59663544fe19bee7cb182a997ff` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:00.861157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fddd59663544fe19bee7cb182a997ff)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:00.863117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:00.896579 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:00.914821 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fddd59663544fe19bee7cb182a997ff', 'request_id': 'req-976c88d4-2e55-4345-b634-2187b6f3d5bd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.921139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fddd59663544fe19bee7cb182a997ff', 'request_id': 'req-976c88d4-2e55-4345-b634-2187b6f3d5bd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.932299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fddd59663544fe19bee7cb182a997ff', 'request_id': 'req-976c88d4-2e55-4345-b634-2187b6f3d5bd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.943523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] The token cache is being invalidate because project 3fddd59663544fe19bee7cb182a997ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:00.943867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.944550 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-976c88d4-2e55-4345-b634-2187b6f3d5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:00.946045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1373/2775] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:00 2022] DELETE /identity/v3/projects/3fddd59663544fe19bee7cb182a997ff => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:00.951002 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40acc-19e9-4ee8-b161-ccc365f850a6 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:00.951478 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40acc-19e9-4ee8-b161-ccc365f850a6 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:00.951601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40acc-19e9-4ee8-b161-ccc365f850a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:00.971715 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0bc40acc-19e9-4ee8-b161-ccc365f850a6 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:00.972899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0bc40acc-19e9-4ee8-b161-ccc365f850a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:01.039276 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1403/2776] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:43:01.047276 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c6bbe-cbe8-48f9-bea8-814422c9160c None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.047561 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c6bbe-cbe8-48f9-bea8-814422c9160c None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.047831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c6bbe-cbe8-48f9-bea8-814422c9160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.070519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-571c6bbe-cbe8-48f9-bea8-814422c9160c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:01.071699 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-571c6bbe-cbe8-48f9-bea8-814422c9160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:01.080288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1374/2777] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:01.084646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc40acc-19e9-4ee8-b161-ccc365f850a6 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.095406 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc40acc-19e9-4ee8-b161-ccc365f850a6 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.103252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e650c-33cb-436a-a6ab-8602fb4406b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.104045 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e650c-33cb-436a-a6ab-8602fb4406b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.104436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e650c-33cb-436a-a6ab-8602fb4406b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.104847 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e650c-33cb-436a-a6ab-8602fb4406b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.105883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e650c-33cb-436a-a6ab-8602fb4406b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:43:01.106340 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e650c-33cb-436a-a6ab-8602fb4406b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.108835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e650c-33cb-436a-a6ab-8602fb4406b9 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.123274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1404/2778] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:43:01.127930 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c6bbe-cbe8-48f9-bea8-814422c9160c None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.138131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c6bbe-cbe8-48f9-bea8-814422c9160c None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.144886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce20cf9-1594-432d-af36-0fb6257186be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.145485 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce20cf9-1594-432d-af36-0fb6257186be admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.145763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce20cf9-1594-432d-af36-0fb6257186be admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.146031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce20cf9-1594-432d-af36-0fb6257186be admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.146663 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce20cf9-1594-432d-af36-0fb6257186be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.148776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce20cf9-1594-432d-af36-0fb6257186be admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.180049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1375/2779] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:01 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:01.185090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e650c-33cb-436a-a6ab-8602fb4406b9 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.195385 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e650c-33cb-436a-a6ab-8602fb4406b9 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.221145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:01.254607 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1957ee-17ee-420a-b746-fd1329863cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.255146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1957ee-17ee-420a-b746-fd1329863cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.255428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1957ee-17ee-420a-b746-fd1329863cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.255705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1957ee-17ee-420a-b746-fd1329863cdb admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.256581 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1957ee-17ee-420a-b746-fd1329863cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.258551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1957ee-17ee-420a-b746-fd1329863cdb admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.280725 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1405/2780] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:01 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:01.284957 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce20cf9-1594-432d-af36-0fb6257186be admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.295826 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce20cf9-1594-432d-af36-0fb6257186be admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.301228 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be4a95-a50a-4cf6-9d85-8d02e9539118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.301833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be4a95-a50a-4cf6-9d85-8d02e9539118 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.302111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be4a95-a50a-4cf6-9d85-8d02e9539118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.302394 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be4a95-a50a-4cf6-9d85-8d02e9539118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.303026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be4a95-a50a-4cf6-9d85-8d02e9539118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.304918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be4a95-a50a-4cf6-9d85-8d02e9539118 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.315458 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1376/2781] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:01.319527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1957ee-17ee-420a-b746-fd1329863cdb admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.329547 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1957ee-17ee-420a-b746-fd1329863cdb admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.334366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8223-22c9-4252-bfa1-6094fb0b8cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.334997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8223-22c9-4252-bfa1-6094fb0b8cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.335280 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8223-22c9-4252-bfa1-6094fb0b8cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.335549 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8223-22c9-4252-bfa1-6094fb0b8cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.336178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e8223-22c9-4252-bfa1-6094fb0b8cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.337829 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e8223-22c9-4252-bfa1-6094fb0b8cf3 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.348297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1406/2782] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:01.352976 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be4a95-a50a-4cf6-9d85-8d02e9539118 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.363364 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be4a95-a50a-4cf6-9d85-8d02e9539118 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.369413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197f532-fdb7-45d8-a6e9-790102b2f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.370062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197f532-fdb7-45d8-a6e9-790102b2f391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.370338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197f532-fdb7-45d8-a6e9-790102b2f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.370607 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197f532-fdb7-45d8-a6e9-790102b2f391 admin admin] PATH_INFO: `/v3/projects/be0066238fc44fb2a832ace938b0f25f/users/fd74c5abc0994273a737d972d0238878/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.387065 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197f532-fdb7-45d8-a6e9-790102b2f391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0066238fc44fb2a832ace938b0f25f, user_id=fd74c5abc0994273a737d972d0238878, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.389815 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197f532-fdb7-45d8-a6e9-790102b2f391 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.405375 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1377/2783] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:01 2022] PUT /identity/v3/projects/be0066238fc44fb2a832ace938b0f25f/users/fd74c5abc0994273a737d972d0238878/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:01.475343 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17562c-00bc-42cb-a9c6-bbe30ed99706 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.475780 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17562c-00bc-42cb-a9c6-bbe30ed99706 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.476064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17562c-00bc-42cb-a9c6-bbe30ed99706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.505566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-3a17562c-00bc-42cb-a9c6-bbe30ed99706 None None] MFA Rules not processed for user `fd74c5abc0994273a737d972d0238878`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:01.506808 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3a17562c-00bc-42cb-a9c6-bbe30ed99706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:01.572596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1407/2784] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:01.577332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197f532-fdb7-45d8-a6e9-790102b2f391 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.646941 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197f532-fdb7-45d8-a6e9-790102b2f391 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.653489 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfb071-d7fc-42ae-956d-89166cb66923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.654081 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfb071-d7fc-42ae-956d-89166cb66923 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.654359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfb071-d7fc-42ae-956d-89166cb66923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.654622 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfb071-d7fc-42ae-956d-89166cb66923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.655261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfb071-d7fc-42ae-956d-89166cb66923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.657183 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfb071-d7fc-42ae-956d-89166cb66923 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.689126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1378/2785] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:01 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:01.694098 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17562c-00bc-42cb-a9c6-bbe30ed99706 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.705320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17562c-00bc-42cb-a9c6-bbe30ed99706 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.773179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fb183-f8c4-4eb2-8f21-55c7b900213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.773805 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fb183-f8c4-4eb2-8f21-55c7b900213a admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.774086 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fb183-f8c4-4eb2-8f21-55c7b900213a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.774391 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fb183-f8c4-4eb2-8f21-55c7b900213a admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.775040 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fb183-f8c4-4eb2-8f21-55c7b900213a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.777026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fb183-f8c4-4eb2-8f21-55c7b900213a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.802149 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1408/2786] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:01 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:01.806344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfb071-d7fc-42ae-956d-89166cb66923 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.817150 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfb071-d7fc-42ae-956d-89166cb66923 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.822318 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9202f-b8d6-447a-976a-cfd7f395b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.822923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9202f-b8d6-447a-976a-cfd7f395b420 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.823204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9202f-b8d6-447a-976a-cfd7f395b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.823480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9202f-b8d6-447a-976a-cfd7f395b420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.824131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9202f-b8d6-447a-976a-cfd7f395b420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.825778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9202f-b8d6-447a-976a-cfd7f395b420 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.836730 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1379/2787] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:43:01.840909 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fb183-f8c4-4eb2-8f21-55c7b900213a admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.851272 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fb183-f8c4-4eb2-8f21-55c7b900213a admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.856223 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3121a-9ce9-4702-b814-c459df100979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.856912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3121a-9ce9-4702-b814-c459df100979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.857190 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3121a-9ce9-4702-b814-c459df100979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.857487 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3121a-9ce9-4702-b814-c459df100979 admin admin] PATH_INFO: `/v3/projects/53472151b4ea4a6399b6620e617b9a32/users/31e17c8904b34b98b76e34659b0002e6/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.873144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3121a-9ce9-4702-b814-c459df100979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53472151b4ea4a6399b6620e617b9a32, user_id=31e17c8904b34b98b76e34659b0002e6, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.875868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3121a-9ce9-4702-b814-c459df100979 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.891408 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1409/2788] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:01 2022] PUT /identity/v3/projects/53472151b4ea4a6399b6620e617b9a32/users/31e17c8904b34b98b76e34659b0002e6/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:01.895476 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9202f-b8d6-447a-976a-cfd7f395b420 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:01.905925 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9202f-b8d6-447a-976a-cfd7f395b420 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:01.926351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:01.971371 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a6b60-ce1f-4a61-93c2-20097ba55312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:01.972176 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6b60-ce1f-4a61-93c2-20097ba55312 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:01.972557 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6b60-ce1f-4a61-93c2-20097ba55312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:01.972855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6b60-ce1f-4a61-93c2-20097ba55312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:01.973806 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a6b60-ce1f-4a61-93c2-20097ba55312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:01.977085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a6b60-ce1f-4a61-93c2-20097ba55312 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:01.991056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1380/2789] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:01.996064 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3121a-9ce9-4702-b814-c459df100979 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:02.004107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:02.011305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3121a-9ce9-4702-b814-c459df100979 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:02.019828 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de61a-3ec7-4598-89da-9fbd1c29123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:02.020728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de61a-3ec7-4598-89da-9fbd1c29123c admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:02.021010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de61a-3ec7-4598-89da-9fbd1c29123c admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:02.021346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de61a-3ec7-4598-89da-9fbd1c29123c admin admin] PATH_INFO: `/v3/projects/53472151b4ea4a6399b6620e617b9a32/users/31e17c8904b34b98b76e34659b0002e6/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:02.023925 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1de61a-3ec7-4598-89da-9fbd1c29123c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53472151b4ea4a6399b6620e617b9a32, user_id=31e17c8904b34b98b76e34659b0002e6, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:02.026631 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1de61a-3ec7-4598-89da-9fbd1c29123c admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:02.037222 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1410/2790] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:01 2022] PUT /identity/v3/projects/53472151b4ea4a6399b6620e617b9a32/users/31e17c8904b34b98b76e34659b0002e6/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:43:02.047502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee4205-86b9-4131-9259-edf045868531 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:02.047793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee4205-86b9-4131-9259-edf045868531 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:02.048070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee4205-86b9-4131-9259-edf045868531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:02.077166 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-16ee4205-86b9-4131-9259-edf045868531 None None] MFA Rules not processed for user `31e17c8904b34b98b76e34659b0002e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:02.078363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-16ee4205-86b9-4131-9259-edf045868531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:02.155656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1381/2791] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:02.168368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de61a-3ec7-4598-89da-9fbd1c29123c admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:02.170281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1a1de61a-3ec7-4598-89da-9fbd1c29123c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:02.229809 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de61a-3ec7-4598-89da-9fbd1c29123c admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:02.234137 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198985a-d4c4-46f0-b38d-b68015423cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:02.234746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198985a-d4c4-46f0-b38d-b68015423cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:02.235020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198985a-d4c4-46f0-b38d-b68015423cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:02.235287 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198985a-d4c4-46f0-b38d-b68015423cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:02.246267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198985a-d4c4-46f0-b38d-b68015423cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:02.247704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198985a-d4c4-46f0-b38d-b68015423cb0 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:02.257442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1411/2792] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:02.588974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee4205-86b9-4131-9259-edf045868531 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:02.598178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee4205-86b9-4131-9259-edf045868531 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:02.603461 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a27d1-1659-4b9a-a155-3ad2dbb6d4b6 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e17c8904b34b98b76e34659b0002e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53472151b4ea4a6399b6620e617b9a32', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:02.604073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a27d1-1659-4b9a-a155-3ad2dbb6d4b6 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:02.604358 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a27d1-1659-4b9a-a155-3ad2dbb6d4b6 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:02.604673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a27d1-1659-4b9a-a155-3ad2dbb6d4b6 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:02.605328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a27d1-1659-4b9a-a155-3ad2dbb6d4b6 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:43:02.605633 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a27d1-1659-4b9a-a155-3ad2dbb6d4b6 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:02.607281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a27d1-1659-4b9a-a155-3ad2dbb6d4b6 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:02.618967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1382/2793] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:43:02.623181 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198985a-d4c4-46f0-b38d-b68015423cb0 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:02.632427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198985a-d4c4-46f0-b38d-b68015423cb0 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:02.637291 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ec977-8cf7-4079-aa73-6b566239f047 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e17c8904b34b98b76e34659b0002e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53472151b4ea4a6399b6620e617b9a32', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:02.637887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ec977-8cf7-4079-aa73-6b566239f047 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:02.638167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ec977-8cf7-4079-aa73-6b566239f047 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:02.638436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ec977-8cf7-4079-aa73-6b566239f047 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:02.639066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ec977-8cf7-4079-aa73-6b566239f047 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:02.641028 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ec977-8cf7-4079-aa73-6b566239f047 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:02.669311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1412/2794] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:02 2022] POST /identity/v3/projects => generated 354 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:02.673587 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a27d1-1659-4b9a-a155-3ad2dbb6d4b6 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:02.684180 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a27d1-1659-4b9a-a155-3ad2dbb6d4b6 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:02.738832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c1378-20a5-46ed-bd4b-3e12494d128e tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e17c8904b34b98b76e34659b0002e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53472151b4ea4a6399b6620e617b9a32', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:02.739426 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c1378-20a5-46ed-bd4b-3e12494d128e tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:02.739703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c1378-20a5-46ed-bd4b-3e12494d128e tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:02.739968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c1378-20a5-46ed-bd4b-3e12494d128e tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:02.740629 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c1378-20a5-46ed-bd4b-3e12494d128e tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:43:02.740935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c1378-20a5-46ed-bd4b-3e12494d128e tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:02.742795 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c1378-20a5-46ed-bd4b-3e12494d128e tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:02.755177 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1383/2795] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:43:02.793890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ec977-8cf7-4079-aa73-6b566239f047 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:02.805534 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ec977-8cf7-4079-aa73-6b566239f047 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:02.812137 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e17c8904b34b98b76e34659b0002e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53472151b4ea4a6399b6620e617b9a32', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:02.812818 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:02.813095 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:02.813363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] PATH_INFO: `/v3/projects/a7ef8e79d16e4ab49866c195ca832b8a` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:02.814636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a7ef8e79d16e4ab49866c195ca832b8a)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:02.816637 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:02.878026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ef8e79d16e4ab49866c195ca832b8a', 'request_id': 'req-274244d7-b389-4c81-a76a-837000e3d9b0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:02.886180 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ef8e79d16e4ab49866c195ca832b8a', 'request_id': 'req-274244d7-b389-4c81-a76a-837000e3d9b0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:02.891877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ef8e79d16e4ab49866c195ca832b8a', 'request_id': 'req-274244d7-b389-4c81-a76a-837000e3d9b0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:02.905296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] The token cache is being invalidate because project a7ef8e79d16e4ab49866c195ca832b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:02.905582 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:02.906255 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-274244d7-b389-4c81-a76a-837000e3d9b0 tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:02.907751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1413/2796] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:02 2022] DELETE /identity/v3/projects/a7ef8e79d16e4ab49866c195ca832b8a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:03.138223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c1378-20a5-46ed-bd4b-3e12494d128e tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:03.140033 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-768c1378-20a5-46ed-bd4b-3e12494d128e tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:03.172552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:03.211243 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c1378-20a5-46ed-bd4b-3e12494d128e tempest-VolumeQuotaClassesTest-1124178763 tempest-VolumeQuotaClassesTest-1124178763-project-admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:03.272735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:03.273392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:03.273665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:03.273938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] PATH_INFO: `/v3/users/fd74c5abc0994273a737d972d0238878` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:03.275076 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd74c5abc0994273a737d972d0238878)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:03.277125 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:03.333101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd74c5abc0994273a737d972d0238878'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:03.333995 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd74c5abc0994273a737d972d0238878'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:03.341932 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd74c5abc0994273a737d972d0238878'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:03.353801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd74c5abc0994273a737d972d0238878'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:03.354441 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd74c5abc0994273a737d972d0238878'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:03.369159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1384/2797] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:03 2022] DELETE /identity/v3/users/fd74c5abc0994273a737d972d0238878 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:03.373776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78736e21-0d9a-4bf3-98e7-3a75cef5cf80 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:03.374329 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78736e21-0d9a-4bf3-98e7-3a75cef5cf80 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:03.374444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78736e21-0d9a-4bf3-98e7-3a75cef5cf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:03.395017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-78736e21-0d9a-4bf3-98e7-3a75cef5cf80 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:03.396232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-78736e21-0d9a-4bf3-98e7-3a75cef5cf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:03.446227 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:03.461153 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1414/2798] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:03.471053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:03.472592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:03.538564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85654b63-e67f-42b6-85c4-04f664acc51c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:03.545720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89782d08-066c-49b9-a6c2-56e30b73bfeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:03.546676 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782d08-066c-49b9-a6c2-56e30b73bfeb service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:03.547060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782d08-066c-49b9-a6c2-56e30b73bfeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:03.547512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782d08-066c-49b9-a6c2-56e30b73bfeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:03.558345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:03.561008 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89782d08-066c-49b9-a6c2-56e30b73bfeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:03.562745 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89782d08-066c-49b9-a6c2-56e30b73bfeb service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:03.573448 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1385/2799] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:43:03.860082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78736e21-0d9a-4bf3-98e7-3a75cef5cf80 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:03.861641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-78736e21-0d9a-4bf3-98e7-3a75cef5cf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:03.874043 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78736e21-0d9a-4bf3-98e7-3a75cef5cf80 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:03.879350 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:03.880024 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:03.880299 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:03.880615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] PATH_INFO: `/v3/projects/be0066238fc44fb2a832ace938b0f25f` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:03.881830 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0066238fc44fb2a832ace938b0f25f)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:03.885187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:03.936371 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0066238fc44fb2a832ace938b0f25f', 'request_id': 'req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:03.942972 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0066238fc44fb2a832ace938b0f25f', 'request_id': 'req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:03.949225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0066238fc44fb2a832ace938b0f25f', 'request_id': 'req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:03.965442 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] The token cache is being invalidate because project be0066238fc44fb2a832ace938b0f25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:03.965738 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:03.966359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:03.967895 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1415/2800] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:03 2022] DELETE /identity/v3/projects/be0066238fc44fb2a832ace938b0f25f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:03.972024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89782d08-066c-49b9-a6c2-56e30b73bfeb service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:03.982013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89782d08-066c-49b9-a6c2-56e30b73bfeb service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:04.040614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:04.041249 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:04.041519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:04.041780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] PATH_INFO: `/v3/users/31e17c8904b34b98b76e34659b0002e6` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:04.042988 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e17c8904b34b98b76e34659b0002e6)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:04.045031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:04.095775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e17c8904b34b98b76e34659b0002e6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:04.096491 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e17c8904b34b98b76e34659b0002e6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:04.104152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e17c8904b34b98b76e34659b0002e6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:04.121938 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e17c8904b34b98b76e34659b0002e6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:04.122840 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-3d8e47af-d42c-44ff-ba9c-25162c5d783f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e17c8904b34b98b76e34659b0002e6'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:04.139640 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1386/2801] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:03 2022] DELETE /identity/v3/users/31e17c8904b34b98b76e34659b0002e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:04.435899 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:04.437467 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:04.453568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedda6b-dfbc-41fe-8f8a-ae4927a63805 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:04.511939 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:04.512609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:04.512886 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:04.513155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] PATH_INFO: `/v3/projects/53472151b4ea4a6399b6620e617b9a32` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:04.514302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53472151b4ea4a6399b6620e617b9a32)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:04.516238 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:04.565985 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53472151b4ea4a6399b6620e617b9a32', 'request_id': 'req-f1a8898c-8160-4b47-9a6f-baeff0847085'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:04.572311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53472151b4ea4a6399b6620e617b9a32', 'request_id': 'req-f1a8898c-8160-4b47-9a6f-baeff0847085'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:04.578453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53472151b4ea4a6399b6620e617b9a32', 'request_id': 'req-f1a8898c-8160-4b47-9a6f-baeff0847085'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:04.592693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] The token cache is being invalidate because project 53472151b4ea4a6399b6620e617b9a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:04.592981 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:04.593606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f1a8898c-8160-4b47-9a6f-baeff0847085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:04.595104 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1416/2802] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:04 2022] DELETE /identity/v3/projects/53472151b4ea4a6399b6620e617b9a32 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:04.601016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c0e0-ce09-43ce-9998-22f9f23e0cf8 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:04.601306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c0e0-ce09-43ce-9998-22f9f23e0cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:04.601582 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c0e0-ce09-43ce-9998-22f9f23e0cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:04.621070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-11e9c0e0-ce09-43ce-9998-22f9f23e0cf8 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:04.622292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-11e9c0e0-ce09-43ce-9998-22f9f23e0cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:04.691127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1387/2803] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:43:04.699354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32164586-9b93-4f66-9584-f3e00809cb25 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:04.699643 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32164586-9b93-4f66-9584-f3e00809cb25 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:04.699919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32164586-9b93-4f66-9584-f3e00809cb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:04.718070 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:04.725308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-32164586-9b93-4f66-9584-f3e00809cb25 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:04.728232 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-32164586-9b93-4f66-9584-f3e00809cb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:04.742318 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1417/2804] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:04.746989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c0e0-ce09-43ce-9998-22f9f23e0cf8 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:04.757608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c0e0-ce09-43ce-9998-22f9f23e0cf8 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:04.763099 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a14fab-f459-40ae-9056-b234b4d4fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:04.763716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a14fab-f459-40ae-9056-b234b4d4fe05 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:04.764001 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a14fab-f459-40ae-9056-b234b4d4fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:04.764275 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a14fab-f459-40ae-9056-b234b4d4fe05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:04.764961 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a14fab-f459-40ae-9056-b234b4d4fe05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:43:04.765263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a14fab-f459-40ae-9056-b234b4d4fe05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:04.766876 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a14fab-f459-40ae-9056-b234b4d4fe05 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:04.779238 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1388/2805] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:43:04.783776 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32164586-9b93-4f66-9584-f3e00809cb25 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:04.793560 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32164586-9b93-4f66-9584-f3e00809cb25 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:04.798894 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a775-a952-4254-924c-48cae2902567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:04.799859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a775-a952-4254-924c-48cae2902567 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:04.800116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a775-a952-4254-924c-48cae2902567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:04.800432 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a775-a952-4254-924c-48cae2902567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:04.801071 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071a775-a952-4254-924c-48cae2902567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:04.803001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071a775-a952-4254-924c-48cae2902567 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:04.834700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1418/2806] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:04 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:04.839266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a14fab-f459-40ae-9056-b234b4d4fe05 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:04.844513 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:04.850868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a14fab-f459-40ae-9056-b234b4d4fe05 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:04.915459 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75728-ae51-4de7-a669-5f7f87eaea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:04.916301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75728-ae51-4de7-a669-5f7f87eaea6f admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:04.916682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75728-ae51-4de7-a669-5f7f87eaea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:04.917026 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75728-ae51-4de7-a669-5f7f87eaea6f admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:04.917964 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab75728-ae51-4de7-a669-5f7f87eaea6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:04.920892 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab75728-ae51-4de7-a669-5f7f87eaea6f admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:04.948468 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1389/2807] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:04 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:04.953178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a775-a952-4254-924c-48cae2902567 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:04.967171 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a775-a952-4254-924c-48cae2902567 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:04.972826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9dca-8797-49fc-9da0-c5be1b7d5158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:04.973457 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9dca-8797-49fc-9da0-c5be1b7d5158 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:04.973735 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9dca-8797-49fc-9da0-c5be1b7d5158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:04.974006 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9dca-8797-49fc-9da0-c5be1b7d5158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:04.974645 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db9dca-8797-49fc-9da0-c5be1b7d5158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:04.976295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db9dca-8797-49fc-9da0-c5be1b7d5158 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:04.986591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1419/2808] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:04.990782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75728-ae51-4de7-a669-5f7f87eaea6f admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:05.001920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75728-ae51-4de7-a669-5f7f87eaea6f admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:05.007996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38962c23-db2b-486e-8ac9-7f88e47a9184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:05.008624 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38962c23-db2b-486e-8ac9-7f88e47a9184 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.008896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38962c23-db2b-486e-8ac9-7f88e47a9184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.009156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38962c23-db2b-486e-8ac9-7f88e47a9184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.009801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38962c23-db2b-486e-8ac9-7f88e47a9184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:05.011390 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38962c23-db2b-486e-8ac9-7f88e47a9184 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:05.022589 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1390/2809] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:05.027059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9dca-8797-49fc-9da0-c5be1b7d5158 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:05.037082 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9dca-8797-49fc-9da0-c5be1b7d5158 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:05.042379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff66c61-06d2-4e5d-9341-fc7a80cfea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:05.043037 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66c61-06d2-4e5d-9341-fc7a80cfea39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.043705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66c61-06d2-4e5d-9341-fc7a80cfea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.043705 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66c61-06d2-4e5d-9341-fc7a80cfea39 admin admin] PATH_INFO: `/v3/projects/8313c3473b154ed389ef64d0590997cd/users/0f46b3b13c1444398917fbb8fa9d75fd/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.059151 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff66c61-06d2-4e5d-9341-fc7a80cfea39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8313c3473b154ed389ef64d0590997cd, user_id=0f46b3b13c1444398917fbb8fa9d75fd, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:05.061996 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff66c61-06d2-4e5d-9341-fc7a80cfea39 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:05.078092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1420/2810] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:05 2022] PUT /identity/v3/projects/8313c3473b154ed389ef64d0590997cd/users/0f46b3b13c1444398917fbb8fa9d75fd/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:05.095505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e275-deb2-4c87-ac4c-354d0d8b7c70 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.095780 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e275-deb2-4c87-ac4c-354d0d8b7c70 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.096055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e275-deb2-4c87-ac4c-354d0d8b7c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.127006 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-3ca2e275-deb2-4c87-ac4c-354d0d8b7c70 None None] MFA Rules not processed for user `0f46b3b13c1444398917fbb8fa9d75fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:05.128762 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-3ca2e275-deb2-4c87-ac4c-354d0d8b7c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:05.207080 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1391/2811] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:05.213206 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff66c61-06d2-4e5d-9341-fc7a80cfea39 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:05.289346 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff66c61-06d2-4e5d-9341-fc7a80cfea39 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:05.295481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e5ce7-b791-4530-b154-de7d1d7c0c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:05.296092 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e5ce7-b791-4530-b154-de7d1d7c0c30 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.296369 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e5ce7-b791-4530-b154-de7d1d7c0c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.296669 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e5ce7-b791-4530-b154-de7d1d7c0c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.297302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e5ce7-b791-4530-b154-de7d1d7c0c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:05.299237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e5ce7-b791-4530-b154-de7d1d7c0c30 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:05.330672 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1421/2812] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:05 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:05.335572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2e275-deb2-4c87-ac4c-354d0d8b7c70 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:05.351576 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2e275-deb2-4c87-ac4c-354d0d8b7c70 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:05.425824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e526114-fa7c-416e-a36e-ccd6dbd50e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:05.426439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e526114-fa7c-416e-a36e-ccd6dbd50e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.426746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e526114-fa7c-416e-a36e-ccd6dbd50e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.427013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e526114-fa7c-416e-a36e-ccd6dbd50e5a admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.427647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e526114-fa7c-416e-a36e-ccd6dbd50e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:05.430785 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e526114-fa7c-416e-a36e-ccd6dbd50e5a admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:05.451464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:05.457373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1392/2813] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:05 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:05.461820 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e5ce7-b791-4530-b154-de7d1d7c0c30 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:05.473924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e5ce7-b791-4530-b154-de7d1d7c0c30 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:05.480020 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b8ba0-d931-414c-9028-06330b5f49a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:05.480667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b8ba0-d931-414c-9028-06330b5f49a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.480994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b8ba0-d931-414c-9028-06330b5f49a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.481251 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b8ba0-d931-414c-9028-06330b5f49a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.481903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b8ba0-d931-414c-9028-06330b5f49a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:05.483555 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b8ba0-d931-414c-9028-06330b5f49a3 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:05.495305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1422/2814] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:43:05.499813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e526114-fa7c-416e-a36e-ccd6dbd50e5a admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:05.510159 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e526114-fa7c-416e-a36e-ccd6dbd50e5a admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:05.516030 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc16e5-8933-4c30-b367-6c9285d3748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:05.516787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc16e5-8933-4c30-b367-6c9285d3748c admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.517062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc16e5-8933-4c30-b367-6c9285d3748c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.517328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc16e5-8933-4c30-b367-6c9285d3748c admin admin] PATH_INFO: `/v3/projects/08f6c93524274cb9b10b023df67654fa/users/82ba21fc8c224913836cd33a356eeaa1/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.532967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc16e5-8933-4c30-b367-6c9285d3748c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f6c93524274cb9b10b023df67654fa, user_id=82ba21fc8c224913836cd33a356eeaa1, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:05.535639 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc16e5-8933-4c30-b367-6c9285d3748c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:05.551768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1393/2815] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:05 2022] PUT /identity/v3/projects/08f6c93524274cb9b10b023df67654fa/users/82ba21fc8c224913836cd33a356eeaa1/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:05.556512 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b8ba0-d931-414c-9028-06330b5f49a3 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:05.566668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b8ba0-d931-414c-9028-06330b5f49a3 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:05.630900 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1bcc9-2691-4c3b-9630-a6b973d5be47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:05.631506 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1bcc9-2691-4c3b-9630-a6b973d5be47 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.631782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1bcc9-2691-4c3b-9630-a6b973d5be47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.632047 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1bcc9-2691-4c3b-9630-a6b973d5be47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.632722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1bcc9-2691-4c3b-9630-a6b973d5be47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:05.634374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1bcc9-2691-4c3b-9630-a6b973d5be47 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:05.644374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1423/2816] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:05.651111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc16e5-8933-4c30-b367-6c9285d3748c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:05.662396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc16e5-8933-4c30-b367-6c9285d3748c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:05.667914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae5f9f-20a1-48e4-8286-99e44940188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:05.668614 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae5f9f-20a1-48e4-8286-99e44940188e admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.668895 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae5f9f-20a1-48e4-8286-99e44940188e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.669171 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae5f9f-20a1-48e4-8286-99e44940188e admin admin] PATH_INFO: `/v3/projects/08f6c93524274cb9b10b023df67654fa/users/82ba21fc8c224913836cd33a356eeaa1/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.671210 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae5f9f-20a1-48e4-8286-99e44940188e admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f6c93524274cb9b10b023df67654fa, user_id=82ba21fc8c224913836cd33a356eeaa1, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:05.673922 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae5f9f-20a1-48e4-8286-99e44940188e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:05.685359 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1394/2817] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:05 2022] PUT /identity/v3/projects/08f6c93524274cb9b10b023df67654fa/users/82ba21fc8c224913836cd33a356eeaa1/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:05.695798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fbb77-42c5-40dd-91b8-da5f1a5d0946 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.696078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fbb77-42c5-40dd-91b8-da5f1a5d0946 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.697134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fbb77-42c5-40dd-91b8-da5f1a5d0946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.722443 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:05.725685 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-d06fbb77-42c5-40dd-91b8-da5f1a5d0946 None None] MFA Rules not processed for user `82ba21fc8c224913836cd33a356eeaa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:05.726967 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d06fbb77-42c5-40dd-91b8-da5f1a5d0946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:05.801686 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1424/2818] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:05.814453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae5f9f-20a1-48e4-8286-99e44940188e admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:05.817518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-64ae5f9f-20a1-48e4-8286-99e44940188e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:05.878387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae5f9f-20a1-48e4-8286-99e44940188e admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:05.883831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f63e32-470b-47d4-bbe4-2636789dac30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:05.884519 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f63e32-470b-47d4-bbe4-2636789dac30 service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:05.884778 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f63e32-470b-47d4-bbe4-2636789dac30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:05.885069 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f63e32-470b-47d4-bbe4-2636789dac30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:05.896952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f63e32-470b-47d4-bbe4-2636789dac30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:05.899970 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f63e32-470b-47d4-bbe4-2636789dac30 service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:05.915322 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1395/2819] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:05.994397 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fbb77-42c5-40dd-91b8-da5f1a5d0946 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:06.005999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fbb77-42c5-40dd-91b8-da5f1a5d0946 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:06.011132 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68d565-e9f3-425d-8dc2-fb66ffe5232f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:06.011774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68d565-e9f3-425d-8dc2-fb66ffe5232f service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:06.012015 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68d565-e9f3-425d-8dc2-fb66ffe5232f service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:06.012296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68d565-e9f3-425d-8dc2-fb66ffe5232f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:06.081120 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68d565-e9f3-425d-8dc2-fb66ffe5232f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:06.082577 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68d565-e9f3-425d-8dc2-fb66ffe5232f service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:06.092717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1425/2820] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:06.396801 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f63e32-470b-47d4-bbe4-2636789dac30 service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:06.464139 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f63e32-470b-47d4-bbe4-2636789dac30 service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:06.468918 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:06.469556 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:06.469831 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:06.470137 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] PATH_INFO: `/v3/users/0f46b3b13c1444398917fbb8fa9d75fd` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:06.471339 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f46b3b13c1444398917fbb8fa9d75fd)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:06.473322 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:06.527198 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f46b3b13c1444398917fbb8fa9d75fd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:06.527852 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f46b3b13c1444398917fbb8fa9d75fd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:06.534846 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f46b3b13c1444398917fbb8fa9d75fd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:06.542868 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:06.548292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f46b3b13c1444398917fbb8fa9d75fd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:06.549086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f46b3b13c1444398917fbb8fa9d75fd'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:06.566505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1396/2821] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:06 2022] DELETE /identity/v3/users/0f46b3b13c1444398917fbb8fa9d75fd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:06.571376 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab01ece-f1df-4573-8f30-30a88f5f7ec5 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:06.571888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab01ece-f1df-4573-8f30-30a88f5f7ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:06.571888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab01ece-f1df-4573-8f30-30a88f5f7ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:06.591994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-0ab01ece-f1df-4573-8f30-30a88f5f7ec5 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:06.593225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0ab01ece-f1df-4573-8f30-30a88f5f7ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:06.653374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1426/2822] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:06.665336 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:06.667045 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:06.728800 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c94a-f158-40b2-9ff3-b4fe61766fc2 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:06.733698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f20ea6-1a88-47a0-bc85-2f98bcf3b4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:06.734307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f20ea6-1a88-47a0-bc85-2f98bcf3b4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:06.734578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f20ea6-1a88-47a0-bc85-2f98bcf3b4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:06.734862 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f20ea6-1a88-47a0-bc85-2f98bcf3b4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:06.745013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f20ea6-1a88-47a0-bc85-2f98bcf3b4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:06.746209 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f20ea6-1a88-47a0-bc85-2f98bcf3b4c3 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:06.756011 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1397/2823] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:07.040708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab01ece-f1df-4573-8f30-30a88f5f7ec5 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:07.042155 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0ab01ece-f1df-4573-8f30-30a88f5f7ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:07.055390 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab01ece-f1df-4573-8f30-30a88f5f7ec5 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:07.063022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:07.063744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:07.064004 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:07.064294 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] PATH_INFO: `/v3/projects/8313c3473b154ed389ef64d0590997cd` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:07.065691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8313c3473b154ed389ef64d0590997cd)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:07.068892 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:07.113757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:07.126704 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8313c3473b154ed389ef64d0590997cd', 'request_id': 'req-dac918b5-9ea0-4838-892c-8042238b95c6'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.133198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8313c3473b154ed389ef64d0590997cd', 'request_id': 'req-dac918b5-9ea0-4838-892c-8042238b95c6'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.141746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8313c3473b154ed389ef64d0590997cd', 'request_id': 'req-dac918b5-9ea0-4838-892c-8042238b95c6'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.160107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] The token cache is being invalidate because project 8313c3473b154ed389ef64d0590997cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:07.160427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.161097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.162673 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1427/2824] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:07 2022] DELETE /identity/v3/projects/8313c3473b154ed389ef64d0590997cd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:07.167131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f20ea6-1a88-47a0-bc85-2f98bcf3b4c3 service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:07.177296 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f20ea6-1a88-47a0-bc85-2f98bcf3b4c3 service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:07.235152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:07.235790 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:07.236060 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:07.236327 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] PATH_INFO: `/v3/users/82ba21fc8c224913836cd33a356eeaa1` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:07.237566 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ba21fc8c224913836cd33a356eeaa1)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:07.239492 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:07.289962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ba21fc8c224913836cd33a356eeaa1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.290656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ba21fc8c224913836cd33a356eeaa1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.298389 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ba21fc8c224913836cd33a356eeaa1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.312962 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ba21fc8c224913836cd33a356eeaa1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.313723 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-d38fa21e-8076-47ba-a36d-cba97e679619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ba21fc8c224913836cd33a356eeaa1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.332870 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1398/2825] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:07 2022] DELETE /identity/v3/users/82ba21fc8c224913836cd33a356eeaa1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:07.612275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:07.613792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:07.627425 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac918b5-9ea0-4838-892c-8042238b95c6 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:07.686454 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:07.687099 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:07.687379 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:07.687665 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] PATH_INFO: `/v3/projects/08f6c93524274cb9b10b023df67654fa` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:07.688885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f6c93524274cb9b10b023df67654fa)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:07.690862 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:07.738076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f6c93524274cb9b10b023df67654fa', 'request_id': 'req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.744794 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f6c93524274cb9b10b023df67654fa', 'request_id': 'req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.751439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f6c93524274cb9b10b023df67654fa', 'request_id': 'req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.767488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] The token cache is being invalidate because project 08f6c93524274cb9b10b023df67654fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:07.767911 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.768681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-c07fb42a-2374-4cf6-af9d-cc3a6cc2afb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:07.770302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1428/2826] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:07 2022] DELETE /identity/v3/projects/08f6c93524274cb9b10b023df67654fa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:07.775402 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847f8e-98dc-434d-aa41-3b46456d1a79 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:07.775906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847f8e-98dc-434d-aa41-3b46456d1a79 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:07.776031 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847f8e-98dc-434d-aa41-3b46456d1a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:07.790236 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:07.797245 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-7a847f8e-98dc-434d-aa41-3b46456d1a79 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:07.799257 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7a847f8e-98dc-434d-aa41-3b46456d1a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:07.862989 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1399/2827] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:07.871036 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e546d-94fb-4f74-ab08-e2b6004b22dc None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:07.871319 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e546d-94fb-4f74-ab08-e2b6004b22dc None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:07.871597 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e546d-94fb-4f74-ab08-e2b6004b22dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:07.892419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-dd8e546d-94fb-4f74-ab08-e2b6004b22dc None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:07.893634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-dd8e546d-94fb-4f74-ab08-e2b6004b22dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:07.902399 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1429/2828] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:07.907380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a847f8e-98dc-434d-aa41-3b46456d1a79 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:07.919984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a847f8e-98dc-434d-aa41-3b46456d1a79 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:07.925480 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888b9fa-6282-4792-badb-357e4cd4d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:07.926111 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888b9fa-6282-4792-badb-357e4cd4d156 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:07.926388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888b9fa-6282-4792-badb-357e4cd4d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:07.926666 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888b9fa-6282-4792-badb-357e4cd4d156 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:07.927301 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888b9fa-6282-4792-badb-357e4cd4d156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:43:07.927602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888b9fa-6282-4792-badb-357e4cd4d156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:07.929253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888b9fa-6282-4792-badb-357e4cd4d156 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:07.941232 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1400/2829] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:43:07.945661 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e546d-94fb-4f74-ab08-e2b6004b22dc None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:07.955154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e546d-94fb-4f74-ab08-e2b6004b22dc None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:07.960320 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27faeb-e54f-402d-8a75-71a9b4bf692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:07.960956 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27faeb-e54f-402d-8a75-71a9b4bf692b admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:07.961237 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27faeb-e54f-402d-8a75-71a9b4bf692b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:07.961509 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27faeb-e54f-402d-8a75-71a9b4bf692b admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:07.962129 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27faeb-e54f-402d-8a75-71a9b4bf692b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:07.964087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27faeb-e54f-402d-8a75-71a9b4bf692b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:07.994970 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1430/2830] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:07 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:43:07.999292 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888b9fa-6282-4792-badb-357e4cd4d156 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:08.009585 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888b9fa-6282-4792-badb-357e4cd4d156 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:08.066959 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11643c6-5396-41f8-befa-3fa3b3924145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:08.067558 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11643c6-5396-41f8-befa-3fa3b3924145 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:08.067833 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11643c6-5396-41f8-befa-3fa3b3924145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:08.068101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11643c6-5396-41f8-befa-3fa3b3924145 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:08.068753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11643c6-5396-41f8-befa-3fa3b3924145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:08.070661 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11643c6-5396-41f8-befa-3fa3b3924145 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:08.097578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1401/2831] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:07 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:08.102373 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27faeb-e54f-402d-8a75-71a9b4bf692b admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:08.120468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27faeb-e54f-402d-8a75-71a9b4bf692b admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:08.126123 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e176649-e600-49e0-b35f-1da0ef9fc3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:08.126744 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176649-e600-49e0-b35f-1da0ef9fc3db admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:08.127091 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176649-e600-49e0-b35f-1da0ef9fc3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:08.127366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176649-e600-49e0-b35f-1da0ef9fc3db admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:08.128019 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e176649-e600-49e0-b35f-1da0ef9fc3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:08.129667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e176649-e600-49e0-b35f-1da0ef9fc3db admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:08.140514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1431/2832] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:08.147254 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11643c6-5396-41f8-befa-3fa3b3924145 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:08.158434 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11643c6-5396-41f8-befa-3fa3b3924145 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:08.164494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aee3f-56e2-4f38-a1dc-8ec2cec5642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:08.165106 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aee3f-56e2-4f38-a1dc-8ec2cec5642e admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:08.165387 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aee3f-56e2-4f38-a1dc-8ec2cec5642e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:08.165644 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aee3f-56e2-4f38-a1dc-8ec2cec5642e admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:08.166299 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aee3f-56e2-4f38-a1dc-8ec2cec5642e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:08.168103 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aee3f-56e2-4f38-a1dc-8ec2cec5642e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:08.179369 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1402/2833] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:08.184052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e176649-e600-49e0-b35f-1da0ef9fc3db admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:08.194296 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e176649-e600-49e0-b35f-1da0ef9fc3db admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:08.199877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56583501-1626-454d-beda-f6c11cc1f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:08.200576 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56583501-1626-454d-beda-f6c11cc1f121 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:08.200835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56583501-1626-454d-beda-f6c11cc1f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:08.201135 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56583501-1626-454d-beda-f6c11cc1f121 admin admin] PATH_INFO: `/v3/projects/e1f6a315e9c94ec39bf539b847c677cd/users/936abcfd163947608dcd3d7a078c312d/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:08.209843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:08.218400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56583501-1626-454d-beda-f6c11cc1f121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f6a315e9c94ec39bf539b847c677cd, user_id=936abcfd163947608dcd3d7a078c312d, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:08.222013 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56583501-1626-454d-beda-f6c11cc1f121 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:08.238076 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1432/2834] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:08 2022] PUT /identity/v3/projects/e1f6a315e9c94ec39bf539b847c677cd/users/936abcfd163947608dcd3d7a078c312d/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:08.243344 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ae126-cce7-4210-933b-39f1b57a75d3 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:08.243684 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ae126-cce7-4210-933b-39f1b57a75d3 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:08.243960 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ae126-cce7-4210-933b-39f1b57a75d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:08.269246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-fe0ae126-cce7-4210-933b-39f1b57a75d3 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:08.270460 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-fe0ae126-cce7-4210-933b-39f1b57a75d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:08.343124 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1403/2835] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:43:08.355293 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56583501-1626-454d-beda-f6c11cc1f121 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:08.358474 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-56583501-1626-454d-beda-f6c11cc1f121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:08.426177 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56583501-1626-454d-beda-f6c11cc1f121 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:08.430187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347f44b-00be-4531-8021-d982d1470f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:08.430798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f44b-00be-4531-8021-d982d1470f88 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:08.431069 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f44b-00be-4531-8021-d982d1470f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:08.431342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f44b-00be-4531-8021-d982d1470f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:08.445924 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347f44b-00be-4531-8021-d982d1470f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:08.447382 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347f44b-00be-4531-8021-d982d1470f88 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:08.458083 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1433/2836] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:09.476787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f1994-2090-482d-8ec8-616938631d09 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:09.477440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f1994-2090-482d-8ec8-616938631d09 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:09.477440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f1994-2090-482d-8ec8-616938631d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:09.503873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:09.516481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-375f1994-2090-482d-8ec8-616938631d09 None None] MFA Rules not processed for user `936abcfd163947608dcd3d7a078c312d`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:09.517741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-375f1994-2090-482d-8ec8-616938631d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:09.589438 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1404/2837] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:09.594054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347f44b-00be-4531-8021-d982d1470f88 service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:09.603752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347f44b-00be-4531-8021-d982d1470f88 service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:09.608667 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c59ca-36c1-4e09-812e-b73466339aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:09.609273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c59ca-36c1-4e09-812e-b73466339aae admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:09.609551 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c59ca-36c1-4e09-812e-b73466339aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:09.609823 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c59ca-36c1-4e09-812e-b73466339aae admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:09.610474 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c59ca-36c1-4e09-812e-b73466339aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:09.612482 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c59ca-36c1-4e09-812e-b73466339aae admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:09.656010 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1434/2838] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:09 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:09.660053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f1994-2090-482d-8ec8-616938631d09 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:09.673517 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f1994-2090-482d-8ec8-616938631d09 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:09.745424 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b797-b187-4114-bcc9-53cebe38dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:09.746036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b797-b187-4114-bcc9-53cebe38dc66 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:09.746312 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b797-b187-4114-bcc9-53cebe38dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:09.746578 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b797-b187-4114-bcc9-53cebe38dc66 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:09.747202 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b797-b187-4114-bcc9-53cebe38dc66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:09.749154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b797-b187-4114-bcc9-53cebe38dc66 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:09.776823 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1405/2839] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:09 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:09.781103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c59ca-36c1-4e09-812e-b73466339aae admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:09.791561 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c59ca-36c1-4e09-812e-b73466339aae admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:09.796507 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e76d95-b48c-4bcb-8fe3-324251662ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:09.797105 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e76d95-b48c-4bcb-8fe3-324251662ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:09.797380 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e76d95-b48c-4bcb-8fe3-324251662ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:09.797646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e76d95-b48c-4bcb-8fe3-324251662ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:09.798286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e76d95-b48c-4bcb-8fe3-324251662ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:09.800215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e76d95-b48c-4bcb-8fe3-324251662ed4 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:09.811347 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1435/2840] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:09.815974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b797-b187-4114-bcc9-53cebe38dc66 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:09.829265 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b797-b187-4114-bcc9-53cebe38dc66 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:09.834986 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949192d-0762-4149-939b-38a87fe15637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:09.835644 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949192d-0762-4149-939b-38a87fe15637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:09.835923 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949192d-0762-4149-939b-38a87fe15637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:09.836192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949192d-0762-4149-939b-38a87fe15637 admin admin] PATH_INFO: `/v3/projects/129fc502d09545d6acb16a7ebe7457ef/users/f2e4188f04a345e0ab97956337185df7/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:09.853266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949192d-0762-4149-939b-38a87fe15637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129fc502d09545d6acb16a7ebe7457ef, user_id=f2e4188f04a345e0ab97956337185df7, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:09.856157 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949192d-0762-4149-939b-38a87fe15637 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:09.872630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1406/2841] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:09 2022] PUT /identity/v3/projects/129fc502d09545d6acb16a7ebe7457ef/users/f2e4188f04a345e0ab97956337185df7/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:09.878783 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e76d95-b48c-4bcb-8fe3-324251662ed4 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:09.892526 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e76d95-b48c-4bcb-8fe3-324251662ed4 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:09.953569 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691c232-88f0-44fe-8388-ab8913869489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:09.954178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691c232-88f0-44fe-8388-ab8913869489 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:09.954453 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691c232-88f0-44fe-8388-ab8913869489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:09.954721 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691c232-88f0-44fe-8388-ab8913869489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:09.955400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691c232-88f0-44fe-8388-ab8913869489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:09.956997 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691c232-88f0-44fe-8388-ab8913869489 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:09.966987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1436/2842] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:09.972117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949192d-0762-4149-939b-38a87fe15637 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:09.985659 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949192d-0762-4149-939b-38a87fe15637 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:09.991277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d692202-d21e-41da-bcbe-44ffdc0fd498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:09.991934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d692202-d21e-41da-bcbe-44ffdc0fd498 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:09.992247 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d692202-d21e-41da-bcbe-44ffdc0fd498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:09.992542 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d692202-d21e-41da-bcbe-44ffdc0fd498 admin admin] PATH_INFO: `/v3/projects/129fc502d09545d6acb16a7ebe7457ef/users/f2e4188f04a345e0ab97956337185df7/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:09.994630 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d692202-d21e-41da-bcbe-44ffdc0fd498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129fc502d09545d6acb16a7ebe7457ef, user_id=f2e4188f04a345e0ab97956337185df7, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:09.997351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d692202-d21e-41da-bcbe-44ffdc0fd498 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:10.008716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1407/2843] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:09 2022] PUT /identity/v3/projects/129fc502d09545d6acb16a7ebe7457ef/users/f2e4188f04a345e0ab97956337185df7/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:10.662647 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d28b3-df14-44a9-96cf-1fa02d23dd7f None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:10.663589 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d28b3-df14-44a9-96cf-1fa02d23dd7f None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:10.663862 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d28b3-df14-44a9-96cf-1fa02d23dd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:10.698885 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-008d28b3-df14-44a9-96cf-1fa02d23dd7f None None] MFA Rules not processed for user `f2e4188f04a345e0ab97956337185df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:10.700168 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-008d28b3-df14-44a9-96cf-1fa02d23dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:10.752855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:10.787187 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1437/2844] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:10.799248 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d692202-d21e-41da-bcbe-44ffdc0fd498 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:10.801360 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4d692202-d21e-41da-bcbe-44ffdc0fd498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:10.861113 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d692202-d21e-41da-bcbe-44ffdc0fd498 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:10.864798 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9302a7-8f52-4166-b0c2-d7fda638202d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:10.865410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9302a7-8f52-4166-b0c2-d7fda638202d service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:10.865687 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9302a7-8f52-4166-b0c2-d7fda638202d service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:10.865955 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9302a7-8f52-4166-b0c2-d7fda638202d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:10.874502 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:10.929167 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9302a7-8f52-4166-b0c2-d7fda638202d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:10.930765 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9302a7-8f52-4166-b0c2-d7fda638202d service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:10.940776 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1408/2845] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:12.337501 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d28b3-df14-44a9-96cf-1fa02d23dd7f None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:12.339291 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-008d28b3-df14-44a9-96cf-1fa02d23dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:12.353428 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d28b3-df14-44a9-96cf-1fa02d23dd7f None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:12.358366 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4f8e7-2150-4dff-a848-855d687f1722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:12.358969 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4f8e7-2150-4dff-a848-855d687f1722 service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:12.359245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4f8e7-2150-4dff-a848-855d687f1722 service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:12.359511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4f8e7-2150-4dff-a848-855d687f1722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:12.369582 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4f8e7-2150-4dff-a848-855d687f1722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:12.371205 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4f8e7-2150-4dff-a848-855d687f1722 service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:12.381221 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1438/2846] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:13.919444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9302a7-8f52-4166-b0c2-d7fda638202d service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:13.999218 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9302a7-8f52-4166-b0c2-d7fda638202d service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:14.003086 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df705612-52c5-4b56-b6ee-ce9b62ffd36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:14.003683 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df705612-52c5-4b56-b6ee-ce9b62ffd36e service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:14.003958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df705612-52c5-4b56-b6ee-ce9b62ffd36e service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:14.004226 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df705612-52c5-4b56-b6ee-ce9b62ffd36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:14.006004 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-df705612-52c5-4b56-b6ee-ce9b62ffd36e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:14.015754 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df705612-52c5-4b56-b6ee-ce9b62ffd36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:14.017207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df705612-52c5-4b56-b6ee-ce9b62ffd36e service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:14.025131 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1409/2847] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:22.376659 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=16 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:24.021518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=49 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:25.845878 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4f8e7-2150-4dff-a848-855d687f1722 service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:25.847438 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9ec4f8e7-2150-4dff-a848-855d687f1722 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:25.911803 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df705612-52c5-4b56-b6ee-ce9b62ffd36e service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:25.932197 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4f8e7-2150-4dff-a848-855d687f1722 service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:25.939090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f481ba-d372-4264-ac05-73767a1aca39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:25.939717 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f481ba-d372-4264-ac05-73767a1aca39 service placement] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:25.939993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f481ba-d372-4264-ac05-73767a1aca39 service placement] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:25.940267 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f481ba-d372-4264-ac05-73767a1aca39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:25.942111 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-16f481ba-d372-4264-ac05-73767a1aca39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:25.954548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f481ba-d372-4264-ac05-73767a1aca39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:25.956166 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f481ba-d372-4264-ac05-73767a1aca39 service placement] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:25.967090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1439/2848] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:25.984022 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df705612-52c5-4b56-b6ee-ce9b62ffd36e service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:25.988857 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:25.989540 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:25.989816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:25.990127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] PATH_INFO: `/v3/users/936abcfd163947608dcd3d7a078c312d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:25.991277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=936abcfd163947608dcd3d7a078c312d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:25.993416 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:26.048204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936abcfd163947608dcd3d7a078c312d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.048965 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936abcfd163947608dcd3d7a078c312d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.057474 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936abcfd163947608dcd3d7a078c312d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.070162 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936abcfd163947608dcd3d7a078c312d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.070856 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936abcfd163947608dcd3d7a078c312d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.085282 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1410/2849] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:25 2022] DELETE /identity/v3/users/936abcfd163947608dcd3d7a078c312d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:43:26.292103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f481ba-d372-4264-ac05-73767a1aca39 service placement] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:26.303906 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f481ba-d372-4264-ac05-73767a1aca39 service placement] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:26.372281 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:26.372958 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:26.373239 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:26.373514 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] PATH_INFO: `/v3/projects/e1f6a315e9c94ec39bf539b847c677cd` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:26.374822 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f6a315e9c94ec39bf539b847c677cd)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:26.377039 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:26.424032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f6a315e9c94ec39bf539b847c677cd', 'request_id': 'req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.430940 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f6a315e9c94ec39bf539b847c677cd', 'request_id': 'req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.436835 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f6a315e9c94ec39bf539b847c677cd', 'request_id': 'req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.458492 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] The token cache is being invalidate because project e1f6a315e9c94ec39bf539b847c677cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:26.459270 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.459786 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.461093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1440/2850] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:26 2022] DELETE /identity/v3/projects/e1f6a315e9c94ec39bf539b847c677cd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:26.466025 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:26.467512 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:26.481883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3c138-8d5d-4f61-840b-1fc711098069 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:26.538392 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:26.539017 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:26.539297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:26.539566 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] PATH_INFO: `/v3/users/f2e4188f04a345e0ab97956337185df7` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:26.540886 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e4188f04a345e0ab97956337185df7)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:26.542921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:26.567481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:26.596028 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e4188f04a345e0ab97956337185df7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.596715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e4188f04a345e0ab97956337185df7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.603744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e4188f04a345e0ab97956337185df7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.616143 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e4188f04a345e0ab97956337185df7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.616993 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-508b4814-74ed-4beb-8026-10a8f932ffd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e4188f04a345e0ab97956337185df7'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.632972 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1411/2851] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:26 2022] DELETE /identity/v3/users/f2e4188f04a345e0ab97956337185df7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:43:26.834421 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:26.835890 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:26.849447 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1afc91-9a2b-4c23-8e7a-50aa0b57798d admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:26.873461 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:26.934824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:26.935753 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:26.936080 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:26.936326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] PATH_INFO: `/v3/projects/129fc502d09545d6acb16a7ebe7457ef` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:26.938772 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=129fc502d09545d6acb16a7ebe7457ef)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:26.941174 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:26.991037 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129fc502d09545d6acb16a7ebe7457ef', 'request_id': 'req-7cf289d7-c15f-4d72-b218-6d0560692c40'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:26.997342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129fc502d09545d6acb16a7ebe7457ef', 'request_id': 'req-7cf289d7-c15f-4d72-b218-6d0560692c40'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:27.003022 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129fc502d09545d6acb16a7ebe7457ef', 'request_id': 'req-7cf289d7-c15f-4d72-b218-6d0560692c40'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:27.016145 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] The token cache is being invalidate because project 129fc502d09545d6acb16a7ebe7457ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:27.016462 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:27.017316 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cf289d7-c15f-4d72-b218-6d0560692c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:27.019126 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1441/2852] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:26 2022] DELETE /identity/v3/projects/129fc502d09545d6acb16a7ebe7457ef => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:27.024362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda2d9-3cd5-48bd-933f-3884c11c9416 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.024865 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda2d9-3cd5-48bd-933f-3884c11c9416 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.024984 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda2d9-3cd5-48bd-933f-3884c11c9416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.046740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-42cda2d9-3cd5-48bd-933f-3884c11c9416 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:27.047952 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-42cda2d9-3cd5-48bd-933f-3884c11c9416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:27.130565 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1412/2853] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:27.139977 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360f08-f91d-443b-8ff9-6dddb0273399 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.140268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360f08-f91d-443b-8ff9-6dddb0273399 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.140615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360f08-f91d-443b-8ff9-6dddb0273399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.162215 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-6d360f08-f91d-443b-8ff9-6dddb0273399 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:27.163434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6d360f08-f91d-443b-8ff9-6dddb0273399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:27.173246 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1442/2854] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:27.178621 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda2d9-3cd5-48bd-933f-3884c11c9416 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.194315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda2d9-3cd5-48bd-933f-3884c11c9416 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.203221 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940dd90-429a-4241-b705-629a4fa57691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.204118 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940dd90-429a-4241-b705-629a4fa57691 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.204483 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940dd90-429a-4241-b705-629a4fa57691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.204824 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940dd90-429a-4241-b705-629a4fa57691 admin admin] PATH_INFO: `/v3/domains` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.205592 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940dd90-429a-4241-b705-629a4fa57691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:43:27.205898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940dd90-429a-4241-b705-629a4fa57691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.207516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940dd90-429a-4241-b705-629a4fa57691 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.220044 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1413/2855] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:43:27.224646 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d360f08-f91d-443b-8ff9-6dddb0273399 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.234404 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d360f08-f91d-443b-8ff9-6dddb0273399 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.240535 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e468d-6f7c-4665-ab6f-78c8b856c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.241144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e468d-6f7c-4665-ab6f-78c8b856c5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.241739 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e468d-6f7c-4665-ab6f-78c8b856c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.242017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e468d-6f7c-4665-ab6f-78c8b856c5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.242657 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e468d-6f7c-4665-ab6f-78c8b856c5c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.244626 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e468d-6f7c-4665-ab6f-78c8b856c5c7 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.273955 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1443/2856] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:27 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:27.278169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940dd90-429a-4241-b705-629a4fa57691 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.289121 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940dd90-429a-4241-b705-629a4fa57691 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.351410 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2730ea-ef7e-4bbc-856c-4372b129f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.352012 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2730ea-ef7e-4bbc-856c-4372b129f377 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.352294 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2730ea-ef7e-4bbc-856c-4372b129f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.352598 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2730ea-ef7e-4bbc-856c-4372b129f377 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.353244 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2730ea-ef7e-4bbc-856c-4372b129f377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.355173 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2730ea-ef7e-4bbc-856c-4372b129f377 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.380277 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1414/2857] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:27 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:27.384444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e468d-6f7c-4665-ab6f-78c8b856c5c7 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.394732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e468d-6f7c-4665-ab6f-78c8b856c5c7 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.402505 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f8731-2ed0-43c7-90d4-f68a4912d71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.403427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f8731-2ed0-43c7-90d4-f68a4912d71e admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.403912 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f8731-2ed0-43c7-90d4-f68a4912d71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.404336 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f8731-2ed0-43c7-90d4-f68a4912d71e admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.405218 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f8731-2ed0-43c7-90d4-f68a4912d71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.408185 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f8731-2ed0-43c7-90d4-f68a4912d71e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.418463 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1444/2858] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:27.422967 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2730ea-ef7e-4bbc-856c-4372b129f377 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.439115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2730ea-ef7e-4bbc-856c-4372b129f377 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.444873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd6fb-11fc-4d57-8f70-76ca962470d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.445482 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd6fb-11fc-4d57-8f70-76ca962470d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.445753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd6fb-11fc-4d57-8f70-76ca962470d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.446015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd6fb-11fc-4d57-8f70-76ca962470d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.446643 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd6fb-11fc-4d57-8f70-76ca962470d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.448215 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd6fb-11fc-4d57-8f70-76ca962470d5 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.460305 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1415/2859] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:27.464504 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f8731-2ed0-43c7-90d4-f68a4912d71e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.474968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f8731-2ed0-43c7-90d4-f68a4912d71e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.480824 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5868a-07f9-487e-9a71-4b8450842c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.481473 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5868a-07f9-487e-9a71-4b8450842c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.481749 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5868a-07f9-487e-9a71-4b8450842c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.482009 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5868a-07f9-487e-9a71-4b8450842c50 admin admin] PATH_INFO: `/v3/projects/ab84c41ce777425cb69790b45def0cb5/users/b3482f3862f54272b201fc558a5526c3/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.501518 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5868a-07f9-487e-9a71-4b8450842c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab84c41ce777425cb69790b45def0cb5, user_id=b3482f3862f54272b201fc558a5526c3, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.504295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5868a-07f9-487e-9a71-4b8450842c50 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.519456 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1445/2860] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:27 2022] PUT /identity/v3/projects/ab84c41ce777425cb69790b45def0cb5/users/b3482f3862f54272b201fc558a5526c3/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:27.529921 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778e6b6-f961-48b5-8f75-6ca5f43bbd32 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.530216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778e6b6-f961-48b5-8f75-6ca5f43bbd32 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.530497 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778e6b6-f961-48b5-8f75-6ca5f43bbd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.539736 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:27.562328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-9778e6b6-f961-48b5-8f75-6ca5f43bbd32 None None] MFA Rules not processed for user `b3482f3862f54272b201fc558a5526c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:27.563526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-9778e6b6-f961-48b5-8f75-6ca5f43bbd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:27.632051 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1416/2861] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:27.636887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5868a-07f9-487e-9a71-4b8450842c50 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.687568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:27.704954 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5868a-07f9-487e-9a71-4b8450842c50 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.709985 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d702-11e0-4252-afd6-1bdaa37156ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.710609 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d702-11e0-4252-afd6-1bdaa37156ea admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.710887 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d702-11e0-4252-afd6-1bdaa37156ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.711154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d702-11e0-4252-afd6-1bdaa37156ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.711793 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008d702-11e0-4252-afd6-1bdaa37156ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.713751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008d702-11e0-4252-afd6-1bdaa37156ea admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.744059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1446/2862] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:27 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:27.748220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778e6b6-f961-48b5-8f75-6ca5f43bbd32 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.759920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778e6b6-f961-48b5-8f75-6ca5f43bbd32 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.823508 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0576152-18cb-4ebe-8fb9-4b84b6533fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.824117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0576152-18cb-4ebe-8fb9-4b84b6533fde admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.824409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0576152-18cb-4ebe-8fb9-4b84b6533fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.824706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0576152-18cb-4ebe-8fb9-4b84b6533fde admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.825340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0576152-18cb-4ebe-8fb9-4b84b6533fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.827665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0576152-18cb-4ebe-8fb9-4b84b6533fde admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.856741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1417/2863] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:27 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:43:27.860694 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d702-11e0-4252-afd6-1bdaa37156ea admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.871368 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d702-11e0-4252-afd6-1bdaa37156ea admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.876263 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05addeb-4e88-4c40-b1b7-0e5d1e6b2c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.876922 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05addeb-4e88-4c40-b1b7-0e5d1e6b2c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.877192 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05addeb-4e88-4c40-b1b7-0e5d1e6b2c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.877471 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05addeb-4e88-4c40-b1b7-0e5d1e6b2c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.878116 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05addeb-4e88-4c40-b1b7-0e5d1e6b2c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.879728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05addeb-4e88-4c40-b1b7-0e5d1e6b2c18 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.891159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1447/2864] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:27.895992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0576152-18cb-4ebe-8fb9-4b84b6533fde admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.907440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0576152-18cb-4ebe-8fb9-4b84b6533fde admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.913061 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bbc98-a21e-43ef-b91a-6e714b55f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.913706 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bbc98-a21e-43ef-b91a-6e714b55f889 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.914087 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bbc98-a21e-43ef-b91a-6e714b55f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.914388 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bbc98-a21e-43ef-b91a-6e714b55f889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.915109 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bbc98-a21e-43ef-b91a-6e714b55f889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.917068 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bbc98-a21e-43ef-b91a-6e714b55f889 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.928732 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1418/2865] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:27.933007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05addeb-4e88-4c40-b1b7-0e5d1e6b2c18 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:27.944374 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05addeb-4e88-4c40-b1b7-0e5d1e6b2c18 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:27.949500 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4578f-3df9-47aa-a71c-c5c04f32055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:27.950137 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4578f-3df9-47aa-a71c-c5c04f32055a admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.950412 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4578f-3df9-47aa-a71c-c5c04f32055a admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.950689 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4578f-3df9-47aa-a71c-c5c04f32055a admin admin] PATH_INFO: `/v3/projects/e930ed1fd53f4cefabae998aab9f87fb/users/90bc2c98e70c4e47863eeff76c91fd54/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:27.966302 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4578f-3df9-47aa-a71c-c5c04f32055a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e930ed1fd53f4cefabae998aab9f87fb, user_id=90bc2c98e70c4e47863eeff76c91fd54, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:27.969049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4578f-3df9-47aa-a71c-c5c04f32055a admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:27.984539 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1448/2866] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:27 2022] PUT /identity/v3/projects/e930ed1fd53f4cefabae998aab9f87fb/users/90bc2c98e70c4e47863eeff76c91fd54/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:27.995854 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb516-6ffa-4e48-bd0d-6ef55e20f688 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:27.996142 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb516-6ffa-4e48-bd0d-6ef55e20f688 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:27.996433 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb516-6ffa-4e48-bd0d-6ef55e20f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:28.025920 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-e53cb516-6ffa-4e48-bd0d-6ef55e20f688 None None] MFA Rules not processed for user `90bc2c98e70c4e47863eeff76c91fd54`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:28.027160 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e53cb516-6ffa-4e48-bd0d-6ef55e20f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:28.095078 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1419/2867] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:28.099983 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4578f-3df9-47aa-a71c-c5c04f32055a admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:28.164702 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4578f-3df9-47aa-a71c-c5c04f32055a admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:28.169730 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b7d6e-e319-48cc-8da4-2dca210741c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:28.170331 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b7d6e-e319-48cc-8da4-2dca210741c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:28.170608 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b7d6e-e319-48cc-8da4-2dca210741c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:28.170877 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b7d6e-e319-48cc-8da4-2dca210741c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:28.171527 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b7d6e-e319-48cc-8da4-2dca210741c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:28.173489 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b7d6e-e319-48cc-8da4-2dca210741c2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:28.203536 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1449/2868] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:28 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:28.207883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb516-6ffa-4e48-bd0d-6ef55e20f688 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:28.213528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:28.220135 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb516-6ffa-4e48-bd0d-6ef55e20f688 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:28.279996 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01cb82-bf07-4a47-800a-ee8aa30c4072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:28.280632 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01cb82-bf07-4a47-800a-ee8aa30c4072 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:28.280914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01cb82-bf07-4a47-800a-ee8aa30c4072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:28.281281 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01cb82-bf07-4a47-800a-ee8aa30c4072 admin admin] PATH_INFO: `/v3/users` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:28.281912 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01cb82-bf07-4a47-800a-ee8aa30c4072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:28.283950 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01cb82-bf07-4a47-800a-ee8aa30c4072 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:28.309169 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1420/2869] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:28 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:28.313375 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b7d6e-e319-48cc-8da4-2dca210741c2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:28.323866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b7d6e-e319-48cc-8da4-2dca210741c2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:28.328768 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41351c59-cc1b-4d57-bb1f-9127da346418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:28.329357 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41351c59-cc1b-4d57-bb1f-9127da346418 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:28.329708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41351c59-cc1b-4d57-bb1f-9127da346418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:28.329987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41351c59-cc1b-4d57-bb1f-9127da346418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:28.330638 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41351c59-cc1b-4d57-bb1f-9127da346418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:28.332234 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41351c59-cc1b-4d57-bb1f-9127da346418 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:28.342987 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1450/2870] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:28.347481 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01cb82-bf07-4a47-800a-ee8aa30c4072 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:28.357822 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01cb82-bf07-4a47-800a-ee8aa30c4072 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:28.363619 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6294eb3-557f-4c67-8ee1-6fed5836a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:28.364263 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294eb3-557f-4c67-8ee1-6fed5836a458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:28.364570 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294eb3-557f-4c67-8ee1-6fed5836a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:28.364837 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294eb3-557f-4c67-8ee1-6fed5836a458 admin admin] PATH_INFO: `/v3/projects/c121e98bf0914e6cb84f7d0ab324f021/users/8c0f0623b30f46e8b4e76743c8d5975b/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:28.382479 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6294eb3-557f-4c67-8ee1-6fed5836a458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c121e98bf0914e6cb84f7d0ab324f021, user_id=8c0f0623b30f46e8b4e76743c8d5975b, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:28.385223 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6294eb3-557f-4c67-8ee1-6fed5836a458 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:28.405939 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1421/2871] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:28 2022] PUT /identity/v3/projects/c121e98bf0914e6cb84f7d0ab324f021/users/8c0f0623b30f46e8b4e76743c8d5975b/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:28.410863 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41351c59-cc1b-4d57-bb1f-9127da346418 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:28.421522 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41351c59-cc1b-4d57-bb1f-9127da346418 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:28.485688 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250137d-d456-4c63-aebf-3570c1b36b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:28.486345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250137d-d456-4c63-aebf-3570c1b36b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:28.486778 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250137d-d456-4c63-aebf-3570c1b36b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:28.487052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250137d-d456-4c63-aebf-3570c1b36b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:28.487696 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250137d-d456-4c63-aebf-3570c1b36b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:28.489345 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250137d-d456-4c63-aebf-3570c1b36b5b admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:28.499400 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1451/2872] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:28.504428 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6294eb3-557f-4c67-8ee1-6fed5836a458 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:28.515264 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6294eb3-557f-4c67-8ee1-6fed5836a458 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:28.521631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78401dd-6ac5-45aa-9e86-139ebd678645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:28.522288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78401dd-6ac5-45aa-9e86-139ebd678645 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:28.522566 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78401dd-6ac5-45aa-9e86-139ebd678645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:28.522832 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78401dd-6ac5-45aa-9e86-139ebd678645 admin admin] PATH_INFO: `/v3/projects/c121e98bf0914e6cb84f7d0ab324f021/users/8c0f0623b30f46e8b4e76743c8d5975b/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:28.525338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78401dd-6ac5-45aa-9e86-139ebd678645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c121e98bf0914e6cb84f7d0ab324f021, user_id=8c0f0623b30f46e8b4e76743c8d5975b, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:28.528034 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78401dd-6ac5-45aa-9e86-139ebd678645 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:28.539303 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1422/2873] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:28 2022] PUT /identity/v3/projects/c121e98bf0914e6cb84f7d0ab324f021/users/8c0f0623b30f46e8b4e76743c8d5975b/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:28.550485 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff2abf-0438-4d53-9a03-db3566cacb52 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:28.550868 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff2abf-0438-4d53-9a03-db3566cacb52 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:28.551229 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff2abf-0438-4d53-9a03-db3566cacb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:28.571860 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:28.588652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-c1ff2abf-0438-4d53-9a03-db3566cacb52 None None] MFA Rules not processed for user `8c0f0623b30f46e8b4e76743c8d5975b`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:28.589891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c1ff2abf-0438-4d53-9a03-db3566cacb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:28.662668 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1452/2874] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:43:28.677328 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78401dd-6ac5-45aa-9e86-139ebd678645 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:28.679453 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b78401dd-6ac5-45aa-9e86-139ebd678645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:28.750935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78401dd-6ac5-45aa-9e86-139ebd678645 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:28.755772 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb1626-08c4-4fc3-a669-b2fc1a6394ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:28.756409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb1626-08c4-4fc3-a669-b2fc1a6394ca service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:28.756694 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb1626-08c4-4fc3-a669-b2fc1a6394ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:28.757089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb1626-08c4-4fc3-a669-b2fc1a6394ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:28.821931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb1626-08c4-4fc3-a669-b2fc1a6394ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:28.823380 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb1626-08c4-4fc3-a669-b2fc1a6394ca service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:28.834507 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1423/2875] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:30.392833 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff2abf-0438-4d53-9a03-db3566cacb52 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:30.394472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-c1ff2abf-0438-4d53-9a03-db3566cacb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:30.407771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff2abf-0438-4d53-9a03-db3566cacb52 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:30.412722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1b200-cbe3-456a-904d-97bf31e4bf7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:30.413326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1b200-cbe3-456a-904d-97bf31e4bf7a service cinder] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:30.413599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1b200-cbe3-456a-904d-97bf31e4bf7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:30.413865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1b200-cbe3-456a-904d-97bf31e4bf7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:30.483439 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1b200-cbe3-456a-904d-97bf31e4bf7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:30.484944 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1b200-cbe3-456a-904d-97bf31e4bf7a service cinder] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:30.494429 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1453/2876] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:31.061352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb1626-08c4-4fc3-a669-b2fc1a6394ca service cinder] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:31.070475 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb1626-08c4-4fc3-a669-b2fc1a6394ca service cinder] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:31.074440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ea0c0-ba2a-46ee-a4f8-58138f73e05b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:31.075049 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea0c0-ba2a-46ee-a4f8-58138f73e05b service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:31.075332 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea0c0-ba2a-46ee-a4f8-58138f73e05b service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:31.075601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea0c0-ba2a-46ee-a4f8-58138f73e05b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:31.082705 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:31.085055 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ea0c0-ba2a-46ee-a4f8-58138f73e05b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:31.086844 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ea0c0-ba2a-46ee-a4f8-58138f73e05b service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:31.096743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1424/2877] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:35.053985 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1b200-cbe3-456a-904d-97bf31e4bf7a service cinder] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:35.116785 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1b200-cbe3-456a-904d-97bf31e4bf7a service cinder] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:35.121490 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:35.122144 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:35.122420 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:35.122690 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] PATH_INFO: `/v3/users/b3482f3862f54272b201fc558a5526c3` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:35.123831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3482f3862f54272b201fc558a5526c3)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:35.125813 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:35.164167 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:35.177775 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3482f3862f54272b201fc558a5526c3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.178435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3482f3862f54272b201fc558a5526c3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.179044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3482f3862f54272b201fc558a5526c3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.185935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3482f3862f54272b201fc558a5526c3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.198963 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3482f3862f54272b201fc558a5526c3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.214554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1454/2878] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:35 2022] DELETE /identity/v3/users/b3482f3862f54272b201fc558a5526c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:35.219117 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b35f9-5934-4078-b5d7-33d94a285793 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:35.219599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b35f9-5934-4078-b5d7-33d94a285793 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:35.219740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b35f9-5934-4078-b5d7-33d94a285793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:35.246656 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-c11b35f9-5934-4078-b5d7-33d94a285793 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:35.247873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c11b35f9-5934-4078-b5d7-33d94a285793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:35.315430 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1425/2879] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:35.325575 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:35.327189 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:35.388853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2a779-8d72-4f65-bec6-0ea56f9c7175 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:35.393034 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948001c-b813-48d7-b4db-c6c6f5a1151b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:35.393639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948001c-b813-48d7-b4db-c6c6f5a1151b service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:35.393919 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948001c-b813-48d7-b4db-c6c6f5a1151b service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:35.394191 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948001c-b813-48d7-b4db-c6c6f5a1151b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:35.404557 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948001c-b813-48d7-b4db-c6c6f5a1151b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:35.406026 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948001c-b813-48d7-b4db-c6c6f5a1151b service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:35.415856 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1455/2880] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:35.699817 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b35f9-5934-4078-b5d7-33d94a285793 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:35.702192 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-c11b35f9-5934-4078-b5d7-33d94a285793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:35.717903 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b35f9-5934-4078-b5d7-33d94a285793 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:35.722552 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:35.723698 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:35.723973 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:35.724240 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] PATH_INFO: `/v3/projects/ab84c41ce777425cb69790b45def0cb5` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:35.725409 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab84c41ce777425cb69790b45def0cb5)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:35.727528 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:35.779297 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab84c41ce777425cb69790b45def0cb5', 'request_id': 'req-623814f7-911b-49c2-851a-7043ed86d7c0'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.785735 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab84c41ce777425cb69790b45def0cb5', 'request_id': 'req-623814f7-911b-49c2-851a-7043ed86d7c0'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.795132 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab84c41ce777425cb69790b45def0cb5', 'request_id': 'req-623814f7-911b-49c2-851a-7043ed86d7c0'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.806454 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] The token cache is being invalidate because project ab84c41ce777425cb69790b45def0cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:35.806740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.807362 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.808900 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1426/2881] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:35 2022] DELETE /identity/v3/projects/ab84c41ce777425cb69790b45def0cb5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:43:35.813103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948001c-b813-48d7-b4db-c6c6f5a1151b service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:35.823568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948001c-b813-48d7-b4db-c6c6f5a1151b service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:35.886158 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:35.888700 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:35.888978 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:35.889249 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] PATH_INFO: `/v3/users/90bc2c98e70c4e47863eeff76c91fd54` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:35.890444 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90bc2c98e70c4e47863eeff76c91fd54)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:35.893146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:35.945757 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90bc2c98e70c4e47863eeff76c91fd54'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.946401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90bc2c98e70c4e47863eeff76c91fd54'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.946999 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90bc2c98e70c4e47863eeff76c91fd54'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.952363 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:35.954564 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90bc2c98e70c4e47863eeff76c91fd54'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.970250 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90bc2c98e70c4e47863eeff76c91fd54'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:35.985960 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1456/2882] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:35 2022] DELETE /identity/v3/users/90bc2c98e70c4e47863eeff76c91fd54 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:36.278586 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:36.280119 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:36.296315 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623814f7-911b-49c2-851a-7043ed86d7c0 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:36.354909 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:36.355451 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:36.355725 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:36.355992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] PATH_INFO: `/v3/projects/e930ed1fd53f4cefabae998aab9f87fb` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:36.357182 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e930ed1fd53f4cefabae998aab9f87fb)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:36.359083 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:36.382414 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:36.412746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e930ed1fd53f4cefabae998aab9f87fb', 'request_id': 'req-11d9fa4f-5596-4db2-8965-fbade6dba03e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:36.418936 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e930ed1fd53f4cefabae998aab9f87fb', 'request_id': 'req-11d9fa4f-5596-4db2-8965-fbade6dba03e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:36.428931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e930ed1fd53f4cefabae998aab9f87fb', 'request_id': 'req-11d9fa4f-5596-4db2-8965-fbade6dba03e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:36.438990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] The token cache is being invalidate because project e930ed1fd53f4cefabae998aab9f87fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:36.439251 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:36.439864 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:36.441411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1427/2883] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:36 2022] DELETE /identity/v3/projects/e930ed1fd53f4cefabae998aab9f87fb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:36.445567 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:36.446980 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:36.459742 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846bfc8-1b3f-4b7f-9b1b-04d6cc534d23 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:36.519118 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:36.519864 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:36.520140 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:36.520413 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] PATH_INFO: `/v3/users/8c0f0623b30f46e8b4e76743c8d5975b` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:36.521595 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0f0623b30f46e8b4e76743c8d5975b)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:36.523562 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:36.577384 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0f0623b30f46e8b4e76743c8d5975b'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:36.578052 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0f0623b30f46e8b4e76743c8d5975b'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:36.578652 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0f0623b30f46e8b4e76743c8d5975b'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:36.586253 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0f0623b30f46e8b4e76743c8d5975b'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:36.601758 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-53c3c999-ce10-4aa8-9cd4-31c0c004d6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0f0623b30f46e8b4e76743c8d5975b'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:36.617819 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1457/2884] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:36 2022] DELETE /identity/v3/users/8c0f0623b30f46e8b4e76743c8d5975b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:36.896356 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:36.897871 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:36.911653 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9fa4f-5596-4db2-8965-fbade6dba03e admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:36.970608 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:36.971246 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:36.971523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:36.971793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] PATH_INFO: `/v3/projects/c121e98bf0914e6cb84f7d0ab324f021` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:36.972992 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c121e98bf0914e6cb84f7d0ab324f021)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:36.975529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:37.025884 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c121e98bf0914e6cb84f7d0ab324f021', 'request_id': 'req-73b9d477-f9c8-4d39-8af4-14973d97eb8e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:37.031998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c121e98bf0914e6cb84f7d0ab324f021', 'request_id': 'req-73b9d477-f9c8-4d39-8af4-14973d97eb8e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:37.042979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c121e98bf0914e6cb84f7d0ab324f021', 'request_id': 'req-73b9d477-f9c8-4d39-8af4-14973d97eb8e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:37.054285 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] The token cache is being invalidate because project c121e98bf0914e6cb84f7d0ab324f021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:37.054573 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:37.055225 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-73b9d477-f9c8-4d39-8af4-14973d97eb8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:37.056782 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1428/2885] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:36 2022] DELETE /identity/v3/projects/c121e98bf0914e6cb84f7d0ab324f021 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:43:37.061795 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f5c7c-52eb-4987-b165-65162288a6e1 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:37.062094 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f5c7c-52eb-4987-b165-65162288a6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:37.062348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f5c7c-52eb-4987-b165-65162288a6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:37.082935 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4e5f5c7c-52eb-4987-b165-65162288a6e1 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:37.084619 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4e5f5c7c-52eb-4987-b165-65162288a6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:37.131728 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:37.148360 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1458/2886] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:37.156287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e20de-cbd2-48b1-a2ed-7363204005ce None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:37.156605 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e20de-cbd2-48b1-a2ed-7363204005ce None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:37.156896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e20de-cbd2-48b1-a2ed-7363204005ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:37.177863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-536e20de-cbd2-48b1-a2ed-7363204005ce None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:37.179056 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-536e20de-cbd2-48b1-a2ed-7363204005ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:37.190601 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1429/2887] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:37.196087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f5c7c-52eb-4987-b165-65162288a6e1 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:37.207054 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f5c7c-52eb-4987-b165-65162288a6e1 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:37.214212 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e249e1-35e0-4803-96b3-23e1ff86843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:37.215110 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e249e1-35e0-4803-96b3-23e1ff86843d admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:37.215452 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e249e1-35e0-4803-96b3-23e1ff86843d admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:37.215798 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e249e1-35e0-4803-96b3-23e1ff86843d admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:37.216869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e249e1-35e0-4803-96b3-23e1ff86843d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:43:37.217275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e249e1-35e0-4803-96b3-23e1ff86843d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:37.219722 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e249e1-35e0-4803-96b3-23e1ff86843d admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:37.238338 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1459/2888] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:43:37.243151 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e20de-cbd2-48b1-a2ed-7363204005ce None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:37.253082 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e20de-cbd2-48b1-a2ed-7363204005ce None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:37.259168 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453c2d8-78cd-4fff-91f8-d27f8aba0ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:37.259775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453c2d8-78cd-4fff-91f8-d27f8aba0ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:37.260054 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453c2d8-78cd-4fff-91f8-d27f8aba0ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:37.260321 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453c2d8-78cd-4fff-91f8-d27f8aba0ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:37.261070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453c2d8-78cd-4fff-91f8-d27f8aba0ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:37.263000 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453c2d8-78cd-4fff-91f8-d27f8aba0ea9 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:37.295457 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1430/2889] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:37 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:37.299865 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e249e1-35e0-4803-96b3-23e1ff86843d admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:37.310384 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e249e1-35e0-4803-96b3-23e1ff86843d admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:37.377007 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5e879-d384-4ab2-b5d3-3685726c74b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:37.377615 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5e879-d384-4ab2-b5d3-3685726c74b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:37.377893 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5e879-d384-4ab2-b5d3-3685726c74b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:37.378159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5e879-d384-4ab2-b5d3-3685726c74b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:37.378850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5e879-d384-4ab2-b5d3-3685726c74b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:37.381408 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5e879-d384-4ab2-b5d3-3685726c74b8 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:37.405288 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1460/2890] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:37 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:37.409505 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453c2d8-78cd-4fff-91f8-d27f8aba0ea9 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:37.420179 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453c2d8-78cd-4fff-91f8-d27f8aba0ea9 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:37.425152 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb01ab-a137-4d4c-911b-4bd21afa9361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:37.425759 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb01ab-a137-4d4c-911b-4bd21afa9361 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:37.426036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb01ab-a137-4d4c-911b-4bd21afa9361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:37.426307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb01ab-a137-4d4c-911b-4bd21afa9361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:37.427673 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb01ab-a137-4d4c-911b-4bd21afa9361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:37.429287 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb01ab-a137-4d4c-911b-4bd21afa9361 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:37.434750 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:37.440122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1431/2891] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:43:37.444273 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5e879-d384-4ab2-b5d3-3685726c74b8 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:37.454552 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5e879-d384-4ab2-b5d3-3685726c74b8 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:37.459698 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af6316-11dd-4e56-90cd-280cd11b5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:37.460339 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af6316-11dd-4e56-90cd-280cd11b5480 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:37.460678 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af6316-11dd-4e56-90cd-280cd11b5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:37.460979 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af6316-11dd-4e56-90cd-280cd11b5480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:37.461636 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af6316-11dd-4e56-90cd-280cd11b5480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:37.463289 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af6316-11dd-4e56-90cd-280cd11b5480 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:37.474178 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1461/2892] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:37.478524 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb01ab-a137-4d4c-911b-4bd21afa9361 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:37.489322 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb01ab-a137-4d4c-911b-4bd21afa9361 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:37.494933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b2060-0e85-4cd0-b042-682e16caa812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:37.495590 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b2060-0e85-4cd0-b042-682e16caa812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:37.495873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b2060-0e85-4cd0-b042-682e16caa812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:37.496149 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b2060-0e85-4cd0-b042-682e16caa812 admin admin] PATH_INFO: `/v3/projects/1f4ffb01e41f4d12a8f097fce3109e65/users/677a3bd8b5194c079d2c0175c387fce5/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:37.512367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b2060-0e85-4cd0-b042-682e16caa812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4ffb01e41f4d12a8f097fce3109e65, user_id=677a3bd8b5194c079d2c0175c387fce5, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:37.515105 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b2060-0e85-4cd0-b042-682e16caa812 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:37.530855 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1432/2893] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:37 2022] PUT /identity/v3/projects/1f4ffb01e41f4d12a8f097fce3109e65/users/677a3bd8b5194c079d2c0175c387fce5/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:37.542599 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b6ef-0114-4187-ad8f-e619afd7093c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:37.542883 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b6ef-0114-4187-ad8f-e619afd7093c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:37.543159 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b6ef-0114-4187-ad8f-e619afd7093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:37.571814 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-4d14b6ef-0114-4187-ad8f-e619afd7093c None None] MFA Rules not processed for user `677a3bd8b5194c079d2c0175c387fce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:37.573075 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4d14b6ef-0114-4187-ad8f-e619afd7093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:37.651639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1462/2894] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:37.665753 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b2060-0e85-4cd0-b042-682e16caa812 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:37.667804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b86b2060-0e85-4cd0-b042-682e16caa812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:37.732021 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b2060-0e85-4cd0-b042-682e16caa812 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:37.736260 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e9ee-c017-4205-92b8-eab85e4b01bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f932b95e90774030b003f554d9f90481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:37.736911 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e9ee-c017-4205-92b8-eab85e4b01bd service cinder] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:37.737178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e9ee-c017-4205-92b8-eab85e4b01bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:37.737444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e9ee-c017-4205-92b8-eab85e4b01bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:37.748446 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367e9ee-c017-4205-92b8-eab85e4b01bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:37.750686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367e9ee-c017-4205-92b8-eab85e4b01bd service cinder] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:37.761072 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1433/2895] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:47.012335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14b6ef-0114-4187-ad8f-e619afd7093c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:47.068764 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:47.086354 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14b6ef-0114-4187-ad8f-e619afd7093c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:47.091097 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:47.091723 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:47.092001 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:47.092275 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] PATH_INFO: `/v3/users/677a3bd8b5194c079d2c0175c387fce5` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:47.093466 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=677a3bd8b5194c079d2c0175c387fce5)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:47.095436 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:47.147260 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677a3bd8b5194c079d2c0175c387fce5'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:47.148027 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677a3bd8b5194c079d2c0175c387fce5'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:47.148779 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677a3bd8b5194c079d2c0175c387fce5'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:47.155691 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677a3bd8b5194c079d2c0175c387fce5'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:47.167859 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677a3bd8b5194c079d2c0175c387fce5'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:47.185635 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1463/2896] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:43:47 2022] DELETE /identity/v3/users/677a3bd8b5194c079d2c0175c387fce5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:47.190207 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bb1ea-cbfa-4741-b849-1d0a299fd695 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:47.190715 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bb1ea-cbfa-4741-b849-1d0a299fd695 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:47.190829 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bb1ea-cbfa-4741-b849-1d0a299fd695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:47.211005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-ee6bb1ea-cbfa-4741-b849-1d0a299fd695 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:47.212178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ee6bb1ea-cbfa-4741-b849-1d0a299fd695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:47.281978 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1434/2897] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:47.293681 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:47.295233 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:47.366831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6a8d5-3ea4-48d5-b022-0b901d5bc93e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:47.371923 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0da84-3444-4526-af95-6978b1586341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:47.372563 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0da84-3444-4526-af95-6978b1586341 service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:47.372831 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0da84-3444-4526-af95-6978b1586341 service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:47.373093 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0da84-3444-4526-af95-6978b1586341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:47.382855 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0da84-3444-4526-af95-6978b1586341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:47.384316 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0da84-3444-4526-af95-6978b1586341 service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:47.393869 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1464/2898] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:47.665015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bb1ea-cbfa-4741-b849-1d0a299fd695 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:47.666775 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-ee6bb1ea-cbfa-4741-b849-1d0a299fd695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:47.680294 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bb1ea-cbfa-4741-b849-1d0a299fd695 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:47.686062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:47.686738 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:47.686999 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:47.687323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] PATH_INFO: `/v3/projects/1f4ffb01e41f4d12a8f097fce3109e65` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:47.688529 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4ffb01e41f4d12a8f097fce3109e65)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:47.690352 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:47.741764 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4ffb01e41f4d12a8f097fce3109e65', 'request_id': 'req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:47.748533 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4ffb01e41f4d12a8f097fce3109e65', 'request_id': 'req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:47.758933 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4ffb01e41f4d12a8f097fce3109e65', 'request_id': 'req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:47.772721 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] The token cache is being invalidate because project 1f4ffb01e41f4d12a8f097fce3109e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:43:47.773241 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:47.774023 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-9db1c7ee-fed8-4017-bb59-4c1f55cb6292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:43:47.775675 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1435/2899] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:43:47 2022] DELETE /identity/v3/projects/1f4ffb01e41f4d12a8f097fce3109e65 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:47.781023 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d597a5a-cc6c-4812-b285-598ed4bc007c None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:47.781306 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d597a5a-cc6c-4812-b285-598ed4bc007c None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:47.781578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d597a5a-cc6c-4812-b285-598ed4bc007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:47.801891 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-8d597a5a-cc6c-4812-b285-598ed4bc007c None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:47.803352 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-8d597a5a-cc6c-4812-b285-598ed4bc007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:47.864901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1465/2900] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:47.873085 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6480-5f64-4550-b9c1-449f819dee29 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:47.873394 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6480-5f64-4550-b9c1-449f819dee29 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:47.873662 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6480-5f64-4550-b9c1-449f819dee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:47.882029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:47.896934 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-565c6480-5f64-4550-b9c1-449f819dee29 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:47.898209 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-565c6480-5f64-4550-b9c1-449f819dee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:47.907007 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1436/2901] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:47.911401 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d597a5a-cc6c-4812-b285-598ed4bc007c None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:47.922134 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d597a5a-cc6c-4812-b285-598ed4bc007c None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:47.928300 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9435c-2607-4736-ac3b-1ce9f377d8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:47.928903 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9435c-2607-4736-ac3b-1ce9f377d8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:47.929283 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9435c-2607-4736-ac3b-1ce9f377d8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:47.929537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9435c-2607-4736-ac3b-1ce9f377d8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:47.930434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9435c-2607-4736-ac3b-1ce9f377d8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:43:47.930732 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9435c-2607-4736-ac3b-1ce9f377d8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:47.932334 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9435c-2607-4736-ac3b-1ce9f377d8f7 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:47.934826 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:47.945584 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1466/2902] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Sep 16 19:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:43:47.950506 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c6480-5f64-4550-b9c1-449f819dee29 None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:47.959968 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c6480-5f64-4550-b9c1-449f819dee29 None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:47.964872 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfc0f1-2cc6-4b8e-994d-84dee624f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:47.965464 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfc0f1-2cc6-4b8e-994d-84dee624f2cf admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:47.965743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfc0f1-2cc6-4b8e-994d-84dee624f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:47.966015 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfc0f1-2cc6-4b8e-994d-84dee624f2cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:47.966648 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfc0f1-2cc6-4b8e-994d-84dee624f2cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:47.968595 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfc0f1-2cc6-4b8e-994d-84dee624f2cf admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:47.999373 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1437/2903] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:47 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:48.004231 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9435c-2607-4736-ac3b-1ce9f377d8f7 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:48.015941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9435c-2607-4736-ac3b-1ce9f377d8f7 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:48.079752 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f4ef-13af-4441-a2a5-3c7cf946f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:48.080640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f4ef-13af-4441-a2a5-3c7cf946f7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:48.080941 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f4ef-13af-4441-a2a5-3c7cf946f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:48.081284 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f4ef-13af-4441-a2a5-3c7cf946f7ec admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:48.082194 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f4ef-13af-4441-a2a5-3c7cf946f7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:48.085274 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f4ef-13af-4441-a2a5-3c7cf946f7ec admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:48.114427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1467/2904] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:48 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:48.118781 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfc0f1-2cc6-4b8e-994d-84dee624f2cf admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:48.129370 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfc0f1-2cc6-4b8e-994d-84dee624f2cf admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:48.134615 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ec8b-d47e-4904-bc69-f6c197d5bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:48.135245 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ec8b-d47e-4904-bc69-f6c197d5bc62 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:48.135546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ec8b-d47e-4904-bc69-f6c197d5bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:48.135816 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ec8b-d47e-4904-bc69-f6c197d5bc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:48.136495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621ec8b-d47e-4904-bc69-f6c197d5bc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:48.138095 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621ec8b-d47e-4904-bc69-f6c197d5bc62 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:48.149046 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1438/2905] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:48.152984 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f4ef-13af-4441-a2a5-3c7cf946f7ec admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:48.163210 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f4ef-13af-4441-a2a5-3c7cf946f7ec admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:48.168434 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6e2e5-c294-4bf4-a968-61b41d87bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:48.169059 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e2e5-c294-4bf4-a968-61b41d87bec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:48.169326 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e2e5-c294-4bf4-a968-61b41d87bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:48.169600 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e2e5-c294-4bf4-a968-61b41d87bec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:48.170251 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6e2e5-c294-4bf4-a968-61b41d87bec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:48.171857 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6e2e5-c294-4bf4-a968-61b41d87bec9 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:48.183040 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1468/2906] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:48.187266 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ec8b-d47e-4904-bc69-f6c197d5bc62 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:48.197490 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ec8b-d47e-4904-bc69-f6c197d5bc62 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:48.202804 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72b9c0-387d-4bd9-b646-daebe38cfb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:48.203462 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72b9c0-387d-4bd9-b646-daebe38cfb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:48.203731 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72b9c0-387d-4bd9-b646-daebe38cfb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:48.204005 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72b9c0-387d-4bd9-b646-daebe38cfb4c admin admin] PATH_INFO: `/v3/projects/40b81d1ed9bb412588f97007da53017c/users/7bb62b2a21ce4f2f8db28afacb4aef6d/roles/4debeb1d97ca4a77afef4ab92d134846` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:48.219377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72b9c0-387d-4bd9-b646-daebe38cfb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b81d1ed9bb412588f97007da53017c, user_id=7bb62b2a21ce4f2f8db28afacb4aef6d, role_id=4debeb1d97ca4a77afef4ab92d134846)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:48.222101 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72b9c0-387d-4bd9-b646-daebe38cfb4c admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:48.242351 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1439/2907] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:48 2022] PUT /identity/v3/projects/40b81d1ed9bb412588f97007da53017c/users/7bb62b2a21ce4f2f8db28afacb4aef6d/roles/4debeb1d97ca4a77afef4ab92d134846 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:48.247359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d3b06-ddcd-4b9d-8ace-cf52d0063270 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:48.247642 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d3b06-ddcd-4b9d-8ace-cf52d0063270 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:48.247916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d3b06-ddcd-4b9d-8ace-cf52d0063270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:48.268266 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-708d3b06-ddcd-4b9d-8ace-cf52d0063270 None None] MFA Rules not processed for user `0f9ac1f3ebbc4a86af050232d3157e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:48.269511 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-708d3b06-ddcd-4b9d-8ace-cf52d0063270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:48.336766 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1469/2908] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:48.346956 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72b9c0-387d-4bd9-b646-daebe38cfb4c admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:48.348797 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-4f72b9c0-387d-4bd9-b646-daebe38cfb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:48.409720 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72b9c0-387d-4bd9-b646-daebe38cfb4c admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:48.414564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0d017-aaba-49d6-8c82-cd11ab0235dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:48.415174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0d017-aaba-49d6-8c82-cd11ab0235dc service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:48.415516 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0d017-aaba-49d6-8c82-cd11ab0235dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:48.415746 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0d017-aaba-49d6-8c82-cd11ab0235dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:48.425447 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0d017-aaba-49d6-8c82-cd11ab0235dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:48.426883 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0d017-aaba-49d6-8c82-cd11ab0235dc service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:48.437025 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1440/2909] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:52.402426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87c0ae-6e12-4640-b0fd-a524ba0063c7 None None] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:52.402993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87c0ae-6e12-4640-b0fd-a524ba0063c7 None None] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:52.402993 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87c0ae-6e12-4640-b0fd-a524ba0063c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:52.434596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.auth.core [None req-ad87c0ae-6e12-4640-b0fd-a524ba0063c7 None None] MFA Rules not processed for user `7bb62b2a21ce4f2f8db28afacb4aef6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:52.435988 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-ad87c0ae-6e12-4640-b0fd-a524ba0063c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:52.504186 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1470/2910] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:52.509204 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0d017-aaba-49d6-8c82-cd11ab0235dc service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:52.519256 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0d017-aaba-49d6-8c82-cd11ab0235dc service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:52.524122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d13183-497e-4f0b-ad73-4e939035d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:52.524768 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d13183-497e-4f0b-ad73-4e939035d35d admin admin] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:52.525053 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d13183-497e-4f0b-ad73-4e939035d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:52.525323 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d13183-497e-4f0b-ad73-4e939035d35d admin admin] PATH_INFO: `/v3/projects` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:52.525974 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d13183-497e-4f0b-ad73-4e939035d35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:52.528073 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d13183-497e-4f0b-ad73-4e939035d35d admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:52.559035 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1441/2911] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Sep 16 19:43:52 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:52.563184 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87c0ae-6e12-4640-b0fd-a524ba0063c7 None None] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:52.571044 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:52.575254 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87c0ae-6e12-4640-b0fd-a524ba0063c7 None None] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:52.638393 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729bef5-b090-4dda-9d51-7f9978f34c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:52.639016 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729bef5-b090-4dda-9d51-7f9978f34c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:52.639290 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729bef5-b090-4dda-9d51-7f9978f34c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:52.639558 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729bef5-b090-4dda-9d51-7f9978f34c90 admin admin] PATH_INFO: `/v3/users` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:52.640179 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729bef5-b090-4dda-9d51-7f9978f34c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:52.642161 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729bef5-b090-4dda-9d51-7f9978f34c90 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:52.666968 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1471/2912] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Sep 16 19:43:52 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:43:52.671298 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d13183-497e-4f0b-ad73-4e939035d35d admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:52.686289 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d13183-497e-4f0b-ad73-4e939035d35d admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:52.691555 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f473ac-6d03-4454-8a85-9c6aa0d49c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:52.692175 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f473ac-6d03-4454-8a85-9c6aa0d49c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:52.692526 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f473ac-6d03-4454-8a85-9c6aa0d49c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:52.692783 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f473ac-6d03-4454-8a85-9c6aa0d49c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:52.693440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f473ac-6d03-4454-8a85-9c6aa0d49c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:52.695156 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f473ac-6d03-4454-8a85-9c6aa0d49c08 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:52.706763 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1442/2913] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:52.711053 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729bef5-b090-4dda-9d51-7f9978f34c90 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:52.721568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729bef5-b090-4dda-9d51-7f9978f34c90 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:52.726543 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ff5d5-04d8-4a79-b573-507eae7589f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:52.727003 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ff5d5-04d8-4a79-b573-507eae7589f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:52.727279 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ff5d5-04d8-4a79-b573-507eae7589f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:52.727550 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ff5d5-04d8-4a79-b573-507eae7589f2 admin admin] PATH_INFO: `/v3/projects/0828c81cb5b646c9b2ea2045f1edcbf4/users/e0adb7b5decd4ccab3a1c79d9594de7e/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:52.742472 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ff5d5-04d8-4a79-b573-507eae7589f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0828c81cb5b646c9b2ea2045f1edcbf4, user_id=e0adb7b5decd4ccab3a1c79d9594de7e, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:52.745225 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ff5d5-04d8-4a79-b573-507eae7589f2 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:52.760654 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1472/2914] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:52 2022] PUT /identity/v3/projects/0828c81cb5b646c9b2ea2045f1edcbf4/users/e0adb7b5decd4ccab3a1c79d9594de7e/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:52.765058 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f473ac-6d03-4454-8a85-9c6aa0d49c08 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:52.775866 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f473ac-6d03-4454-8a85-9c6aa0d49c08 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:52.844769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f49dd-6d1a-422f-a86b-673926611222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:52.845306 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f49dd-6d1a-422f-a86b-673926611222 admin admin] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:52.845590 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f49dd-6d1a-422f-a86b-673926611222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:52.845867 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f49dd-6d1a-422f-a86b-673926611222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:52.846523 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f49dd-6d1a-422f-a86b-673926611222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:52.848216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f49dd-6d1a-422f-a86b-673926611222 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:52.859279 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1443/2915] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Sep 16 19:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:43:52.863445 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ff5d5-04d8-4a79-b573-507eae7589f2 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:52.875359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ff5d5-04d8-4a79-b573-507eae7589f2 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:52.881843 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210868a9-44cb-43fa-8195-8b81b22809f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:52.882628 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210868a9-44cb-43fa-8195-8b81b22809f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:52.883578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210868a9-44cb-43fa-8195-8b81b22809f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:52.883937 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210868a9-44cb-43fa-8195-8b81b22809f0 admin admin] PATH_INFO: `/v3/projects/0828c81cb5b646c9b2ea2045f1edcbf4/users/e0adb7b5decd4ccab3a1c79d9594de7e/roles/71bed99a52684ba990097719b40ef99d` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:52.893896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210868a9-44cb-43fa-8195-8b81b22809f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0828c81cb5b646c9b2ea2045f1edcbf4, user_id=e0adb7b5decd4ccab3a1c79d9594de7e, role_id=71bed99a52684ba990097719b40ef99d)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:52.896701 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210868a9-44cb-43fa-8195-8b81b22809f0 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:52.912741 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1473/2916] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Sep 16 19:43:52 2022] PUT /identity/v3/projects/0828c81cb5b646c9b2ea2045f1edcbf4/users/e0adb7b5decd4ccab3a1c79d9594de7e/roles/71bed99a52684ba990097719b40ef99d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:43:57.392450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5d3d3-805a-4ffa-831e-420f35f41729 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:57.392949 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5d3d3-805a-4ffa-831e-420f35f41729 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:57.393122 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5d3d3-805a-4ffa-831e-420f35f41729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:57.405411 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:57.446679 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-8de5d3d3-805a-4ffa-831e-420f35f41729 None None] MFA Rules not processed for user `e0adb7b5decd4ccab3a1c79d9594de7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:57.447935 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-8de5d3d3-805a-4ffa-831e-420f35f41729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:57.544711 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1444/2917] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:43:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:57.561896 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210868a9-44cb-43fa-8195-8b81b22809f0 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:57.564308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-210868a9-44cb-43fa-8195-8b81b22809f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:57.666748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210868a9-44cb-43fa-8195-8b81b22809f0 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:57.670469 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86465-1e74-4898-807b-24fda764b976 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f83a7e0c14541788c92e3d96b839077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:57.671087 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86465-1e74-4898-807b-24fda764b976 service glance] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:57.671387 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86465-1e74-4898-807b-24fda764b976 service glance] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:57.671651 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86465-1e74-4898-807b-24fda764b976 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:57.725324 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:43:57.736606 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee86465-1e74-4898-807b-24fda764b976 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:57.738616 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee86465-1e74-4898-807b-24fda764b976 service glance] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:57.752684 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1474/2918] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:43:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:43:57.901079 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0dc54-edc2-447d-826b-510651a2722a None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:57.901366 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0dc54-edc2-447d-826b-510651a2722a None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:57.901650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0dc54-edc2-447d-826b-510651a2722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:57.921158 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-0ad0dc54-edc2-447d-826b-510651a2722a None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:43:57.922377 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-0ad0dc54-edc2-447d-826b-510651a2722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:57.981201 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1445/2919] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:43:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:43:58.031090 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86465-1e74-4898-807b-24fda764b976 service glance] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:43:58.032746 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-4ee86465-1e74-4898-807b-24fda764b976 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:43:58.108398 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86465-1e74-4898-807b-24fda764b976 service glance] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:43:58.114994 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ea61c-3a53-4471-bb66-0ee9e359a557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:43:58.115601 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ea61c-3a53-4471-bb66-0ee9e359a557 service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:43:58.115878 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ea61c-3a53-4471-bb66-0ee9e359a557 service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:43:58.116150 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ea61c-3a53-4471-bb66-0ee9e359a557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:43:58.124640 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ea61c-3a53-4471-bb66-0ee9e359a557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:43:58.126243 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ea61c-3a53-4471-bb66-0ee9e359a557 service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:43:58.134516 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1475/2920] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:43:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:44:06.849161 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529b36-a123-4bb2-84fc-6b0b331dcc04 None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:06.849665 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529b36-a123-4bb2-84fc-6b0b331dcc04 None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:06.849769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529b36-a123-4bb2-84fc-6b0b331dcc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:06.870185 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-7c529b36-a123-4bb2-84fc-6b0b331dcc04 None None] MFA Rules not processed for user `7bb62b2a21ce4f2f8db28afacb4aef6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:44:06.871367 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7c529b36-a123-4bb2-84fc-6b0b331dcc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:06.878682 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1446/2921] 10.222.0.49 () {58 vars in 958 bytes} [Fri Sep 16 19:44:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:44:07.483207 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ea61c-3a53-4471-bb66-0ee9e359a557 service swift] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:07.484888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-6f2ea61c-3a53-4471-bb66-0ee9e359a557 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:07.559774 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ea61c-3a53-4471-bb66-0ee9e359a557 service swift] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:07.565596 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5113f6-16d6-4539-b587-d2f056ae6a60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:07.566209 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5113f6-16d6-4539-b587-d2f056ae6a60 service placement] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:07.566488 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5113f6-16d6-4539-b587-d2f056ae6a60 service placement] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:07.566763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5113f6-16d6-4539-b587-d2f056ae6a60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:07.568655 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-0c5113f6-16d6-4539-b587-d2f056ae6a60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:07.581792 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5113f6-16d6-4539-b587-d2f056ae6a60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:07.583468 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5113f6-16d6-4539-b587-d2f056ae6a60 service placement] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:07.596849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1476/2922] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:44:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:44:09.123141 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f95615-89ed-4e6f-beca-565bc5d7594d None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:09.123716 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f95615-89ed-4e6f-beca-565bc5d7594d None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:09.123906 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f95615-89ed-4e6f-beca-565bc5d7594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:09.146863 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-98f95615-89ed-4e6f-beca-565bc5d7594d None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:44:09.148288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-98f95615-89ed-4e6f-beca-565bc5d7594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:09.160050 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1447/2923] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Sep 16 19:44:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:44:09.175639 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5113f6-16d6-4539-b587-d2f056ae6a60 service placement] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:09.189634 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5113f6-16d6-4539-b587-d2f056ae6a60 service placement] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:09.195049 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f052a4-a4fa-47d7-a9ad-e9e4a74baadc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:09.195966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f052a4-a4fa-47d7-a9ad-e9e4a74baadc service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:09.196916 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f052a4-a4fa-47d7-a9ad-e9e4a74baadc service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:09.197419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f052a4-a4fa-47d7-a9ad-e9e4a74baadc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:09.207901 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f052a4-a4fa-47d7-a9ad-e9e4a74baadc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:09.209566 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f052a4-a4fa-47d7-a9ad-e9e4a74baadc service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:09.218499 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1477/2924] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:44:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:44:19.141357 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=63 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:44:19.214962 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=74 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:44:21.284896 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f95615-89ed-4e6f-beca-565bc5d7594d None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:21.286958 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-98f95615-89ed-4e6f-beca-565bc5d7594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:21.370998 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f95615-89ed-4e6f-beca-565bc5d7594d None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:21.376345 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d285a-7b7a-45da-9eea-046ccae51214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:21.376979 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d285a-7b7a-45da-9eea-046ccae51214 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:21.377253 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d285a-7b7a-45da-9eea-046ccae51214 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:21.377518 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d285a-7b7a-45da-9eea-046ccae51214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:21.379229 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-7f4d285a-7b7a-45da-9eea-046ccae51214 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:21.396814 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d285a-7b7a-45da-9eea-046ccae51214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:21.398412 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d285a-7b7a-45da-9eea-046ccae51214 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:21.410795 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1448/2925] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:44:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:44:27.174286 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f052a4-a4fa-47d7-a9ad-e9e4a74baadc service swift] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:27.188872 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f052a4-a4fa-47d7-a9ad-e9e4a74baadc service swift] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:27.196103 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c424d46-07e9-4fb8-bff5-5924816ac3e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:27.196751 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424d46-07e9-4fb8-bff5-5924816ac3e8 service nova] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:27.197025 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424d46-07e9-4fb8-bff5-5924816ac3e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:27.197297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424d46-07e9-4fb8-bff5-5924816ac3e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:27.199252 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-3c424d46-07e9-4fb8-bff5-5924816ac3e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:27.213088 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c424d46-07e9-4fb8-bff5-5924816ac3e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:27.214695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c424d46-07e9-4fb8-bff5-5924816ac3e8 service nova] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:27.226685 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1478/2926] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:44:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:44:31.404971 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=34 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:44:37.221787 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=6 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:44:40.277987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d285a-7b7a-45da-9eea-046ccae51214 service nova] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:40.289699 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d285a-7b7a-45da-9eea-046ccae51214 service nova] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:40.297070 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0c3e4-16d3-4c61-b9a1-c13d6822d7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9988b9fef5c4d559b1918ffe040aaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:40.297777 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0c3e4-16d3-4c61-b9a1-c13d6822d7b8 service nova] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:40.298148 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0c3e4-16d3-4c61-b9a1-c13d6822d7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:40.298500 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0c3e4-16d3-4c61-b9a1-c13d6822d7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:40.300836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-d2c0c3e4-16d3-4c61-b9a1-c13d6822d7b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:40.323178 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0c3e4-16d3-4c61-b9a1-c13d6822d7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:40.326450 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0c3e4-16d3-4c61-b9a1-c13d6822d7b8 service nova] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:40.346379 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1449/2927] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:44:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:44:41.851801 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c424d46-07e9-4fb8-bff5-5924816ac3e8 service nova] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:41.908479 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c424d46-07e9-4fb8-bff5-5924816ac3e8 service nova] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:41.912862 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc113b-ce0c-4ce9-a3ff-11237e5621da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:41.913498 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc113b-ce0c-4ce9-a3ff-11237e5621da service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:41.913771 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc113b-ce0c-4ce9-a3ff-11237e5621da service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:41.914037 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc113b-ce0c-4ce9-a3ff-11237e5621da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:41.923427 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc113b-ce0c-4ce9-a3ff-11237e5621da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:41.924957 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc113b-ce0c-4ce9-a3ff-11237e5621da service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:41.938217 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1479/2928] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:44:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:44:46.139075 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0c3e4-16d3-4c61-b9a1-c13d6822d7b8 service nova] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:46.151535 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0c3e4-16d3-4c61-b9a1-c13d6822d7b8 service nova] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:46.155400 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c815f-0a1f-43f7-bd21-7b4922ea7cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:46.156077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c815f-0a1f-43f7-bd21-7b4922ea7cab service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:46.156444 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c815f-0a1f-43f7-bd21-7b4922ea7cab service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:46.156786 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c815f-0a1f-43f7-bd21-7b4922ea7cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:46.158813 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-a75c815f-0a1f-43f7-bd21-7b4922ea7cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:46.224843 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c815f-0a1f-43f7-bd21-7b4922ea7cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:46.226300 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c815f-0a1f-43f7-bd21-7b4922ea7cab service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:46.236365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1450/2929] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:44:51.932268 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=26 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:44:52.644335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc113b-ce0c-4ce9-a3ff-11237e5621da service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:52.645889 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9cbc113b-ce0c-4ce9-a3ff-11237e5621da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:52.659666 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc113b-ce0c-4ce9-a3ff-11237e5621da service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:52.664295 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:52.664970 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:52.665285 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:52.665554 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] PATH_INFO: `/v3/users/5c941c1962194ec79b18a0eaf98dc893` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:52.666663 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c941c1962194ec79b18a0eaf98dc893)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:52.668622 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:52.717245 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c941c1962194ec79b18a0eaf98dc893'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:52.717920 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c941c1962194ec79b18a0eaf98dc893'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:52.718568 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c941c1962194ec79b18a0eaf98dc893'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:52.726305 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c941c1962194ec79b18a0eaf98dc893'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:52.738308 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c941c1962194ec79b18a0eaf98dc893'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:52.753521 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1480/2930] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:44:52 2022] DELETE /identity/v3/users/5c941c1962194ec79b18a0eaf98dc893 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:44:52.930787 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c815f-0a1f-43f7-bd21-7b4922ea7cab service neutron] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:52.946165 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c815f-0a1f-43f7-bd21-7b4922ea7cab service neutron] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:53.009088 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:53.009734 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:53.010016 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:53.010288 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] PATH_INFO: `/v3/projects/9b9158de13684627b042d2a183330eff` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:53.011439 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9158de13684627b042d2a183330eff)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:53.013408 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:53.065307 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9158de13684627b042d2a183330eff', 'request_id': 'req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.072036 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9158de13684627b042d2a183330eff', 'request_id': 'req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.081793 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9158de13684627b042d2a183330eff', 'request_id': 'req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.092077 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] The token cache is being invalidate because project 9b9158de13684627b042d2a183330eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:44:53.092365 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.093018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.094503 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1451/2931] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:44:52 2022] DELETE /identity/v3/projects/9b9158de13684627b042d2a183330eff => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:44:53.098918 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:53.100529 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:53.114563 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c05b41-afd0-403a-b24e-3e187d62b321 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:53.179748 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:53.180313 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:53.180641 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:53.184695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] PATH_INFO: `/v3/users/cb722c534efa4e87b25f5db03161dfa0` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:53.184695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb722c534efa4e87b25f5db03161dfa0)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:53.184695 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:53.247708 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb722c534efa4e87b25f5db03161dfa0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.248411 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb722c534efa4e87b25f5db03161dfa0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.249065 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb722c534efa4e87b25f5db03161dfa0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.256154 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb722c534efa4e87b25f5db03161dfa0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.268359 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb722c534efa4e87b25f5db03161dfa0'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.270017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:44:53.285021 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1481/2932] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:44:53 2022] DELETE /identity/v3/users/cb722c534efa4e87b25f5db03161dfa0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:44:53.463599 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:44:53.465334 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:44:53.484216 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c4c6d-3643-4d4d-84e2-cd75ff1a34c1 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:44:53.493193 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:44:53.544280 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:44:53.544944 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:44:53.545220 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:44:53.545489 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] PATH_INFO: `/v3/projects/5b0651bb287443c9a01d6476212e25a6` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:44:53.546647 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0651bb287443c9a01d6476212e25a6)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:44:53.548703 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:44:53.597650 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0651bb287443c9a01d6476212e25a6', 'request_id': 'req-dfff647c-7aa2-412e-bc25-5018ad25eab0'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.604990 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0651bb287443c9a01d6476212e25a6', 'request_id': 'req-dfff647c-7aa2-412e-bc25-5018ad25eab0'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.616744 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0651bb287443c9a01d6476212e25a6', 'request_id': 'req-dfff647c-7aa2-412e-bc25-5018ad25eab0'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.633520 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] The token cache is being invalidate because project 5b0651bb287443c9a01d6476212e25a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:44:53.633914 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.635024 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:44:53.637421 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1452/2933] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:44:53 2022] DELETE /identity/v3/projects/5b0651bb287443c9a01d6476212e25a6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:45:03.283349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:45:03.628154 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:46:09.254908 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:46:09.256836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:46:09.418066 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb02edc-3e38-46cc-8fa1-e2dca7899c7e admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:46:09.484966 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfa751-4998-438b-a28a-3049a7694be4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:46:09.485578 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfa751-4998-438b-a28a-3049a7694be4 service placement] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:46:09.485850 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfa751-4998-438b-a28a-3049a7694be4 service placement] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:46:09.486124 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfa751-4998-438b-a28a-3049a7694be4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:46:09.488311 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d4cfa751-4998-438b-a28a-3049a7694be4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:46:09.500928 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfa751-4998-438b-a28a-3049a7694be4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:46:09.502477 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfa751-4998-438b-a28a-3049a7694be4 service placement] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:46:09.513763 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1482/2934] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:46:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:46:19.509348 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=89 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:47:04.381338 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:47:04.383534 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:47:04.474929 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff647c-7aa2-412e-bc25-5018ad25eab0 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:47:04.479029 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937704ca-c654-4d68-b8b0-7d60e3632597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:47:04.479631 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937704ca-c654-4d68-b8b0-7d60e3632597 service neutron] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:47:04.479907 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937704ca-c654-4d68-b8b0-7d60e3632597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:47:04.480174 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937704ca-c654-4d68-b8b0-7d60e3632597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:47:04.482261 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-937704ca-c654-4d68-b8b0-7d60e3632597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:47:04.577466 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937704ca-c654-4d68-b8b0-7d60e3632597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:47:04.578987 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937704ca-c654-4d68-b8b0-7d60e3632597 service neutron] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:47:04.601440 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1453/2935] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:47:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:47:05.800014 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfa751-4998-438b-a28a-3049a7694be4 service placement] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:47:05.801664 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-d4cfa751-4998-438b-a28a-3049a7694be4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:47:05.814897 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfa751-4998-438b-a28a-3049a7694be4 service placement] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:47:05.819510 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea86e-ae69-418c-a595-2f474882a1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ca32d96f9a436782ef0680f6b5dcac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:47:05.820122 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea86e-ae69-418c-a595-2f474882a1ff service neutron] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:47:05.820409 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea86e-ae69-418c-a595-2f474882a1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:47:05.820693 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea86e-ae69-418c-a595-2f474882a1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:47:05.822426 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9f1ea86e-ae69-418c-a595-2f474882a1ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:47:05.835836 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ea86e-ae69-418c-a595-2f474882a1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:47:05.837297 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ea86e-ae69-418c-a595-2f474882a1ff service neutron] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:47:05.848542 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1483/2936] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:47:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:47:08.210873 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb19e9-be6b-430f-a819-dc7c634284ea None None] REQUEST_METHOD: `POST` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:47:08.211347 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb19e9-be6b-430f-a819-dc7c634284ea None None] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:47:08.211467 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb19e9-be6b-430f-a819-dc7c634284ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:47:08.245836 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.auth.core [None req-b8fb19e9-be6b-430f-a819-dc7c634284ea None None] MFA Rules not processed for user `df6eb4ca8ca1446e9bf49ce1ad73989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:47:08.247062 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b8fb19e9-be6b-430f-a819-dc7c634284ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:47:08.288363 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=100 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:47:08.307337 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1454/2937] 10.222.0.49 () {58 vars in 967 bytes} [Fri Sep 16 19:47:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:47:08.356888 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea86e-ae69-418c-a595-2f474882a1ff service neutron] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:47:08.358537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-9f1ea86e-ae69-418c-a595-2f474882a1ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:47:08.439335 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea86e-ae69-418c-a595-2f474882a1ff service neutron] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:47:08.445189 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61124a3-dbfa-4781-bd11-c82e6565b47d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94828db5fc064a539b5b7b17cac1602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:47:08.445777 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61124a3-dbfa-4781-bd11-c82e6565b47d service swift] REQUEST_METHOD: `GET` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:47:08.446078 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61124a3-dbfa-4781-bd11-c82e6565b47d service swift] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:47:08.446349 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61124a3-dbfa-4781-bd11-c82e6565b47d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:47:08.455810 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61124a3-dbfa-4781-bd11-c82e6565b47d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:47:08.457435 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61124a3-dbfa-4781-bd11-c82e6565b47d service swift] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:47:08.465782 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1484/2938] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Sep 16 19:47:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:47:15.376796 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb19e9-be6b-430f-a819-dc7c634284ea None None] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:47:15.378521 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-b8fb19e9-be6b-430f-a819-dc7c634284ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:47:15.483741 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb19e9-be6b-430f-a819-dc7c634284ea None None] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:47:15.489126 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:47:15.489766 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:47:15.490042 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:47:15.490316 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] PATH_INFO: `/v3/users/7bb62b2a21ce4f2f8db28afacb4aef6d` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:47:15.491437 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb62b2a21ce4f2f8db28afacb4aef6d)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:47:15.493413 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:47:15.544089 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb62b2a21ce4f2f8db28afacb4aef6d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:15.544769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb62b2a21ce4f2f8db28afacb4aef6d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:15.552115 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb62b2a21ce4f2f8db28afacb4aef6d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:15.565127 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb62b2a21ce4f2f8db28afacb4aef6d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:15.565740 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb62b2a21ce4f2f8db28afacb4aef6d'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:15.580572 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1455/2939] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:47:15 2022] DELETE /identity/v3/users/7bb62b2a21ce4f2f8db28afacb4aef6d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:47:15.760743 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61124a3-dbfa-4781-bd11-c82e6565b47d service swift] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:47:15.776817 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61124a3-dbfa-4781-bd11-c82e6565b47d service swift] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:47:15.834927 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:47:15.835481 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:47:15.835759 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:47:15.836032 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] PATH_INFO: `/v3/projects/40b81d1ed9bb412588f97007da53017c` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:47:15.837198 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b81d1ed9bb412588f97007da53017c)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:47:15.839130 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:47:15.887503 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b81d1ed9bb412588f97007da53017c', 'request_id': 'req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:15.894102 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b81d1ed9bb412588f97007da53017c', 'request_id': 'req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:15.899520 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b81d1ed9bb412588f97007da53017c', 'request_id': 'req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:15.914342 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] The token cache is being invalidate because project 40b81d1ed9bb412588f97007da53017c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:47:15.914622 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:15.915244 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:15.916849 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1485/2940] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:47:15 2022] DELETE /identity/v3/projects/40b81d1ed9bb412588f97007da53017c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:47:15.921025 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:47:15.922602 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:47:15.936697 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2677d-fe9f-4730-93e1-4ea5ed32f320 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:47:15.973514 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:47:15.999013 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:47:15.999644 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:47:15.999903 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:47:16.000196 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] PATH_INFO: `/v3/users/e0adb7b5decd4ccab3a1c79d9594de7e` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:47:16.001396 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0adb7b5decd4ccab3a1c79d9594de7e)` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:47:16.003877 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:47:16.055018 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0adb7b5decd4ccab3a1c79d9594de7e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:16.055743 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0adb7b5decd4ccab3a1c79d9594de7e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:16.063564 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0adb7b5decd4ccab3a1c79d9594de7e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:16.075931 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0adb7b5decd4ccab3a1c79d9594de7e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:16.076686 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.notifications [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0adb7b5decd4ccab3a1c79d9594de7e'} {{(pid=81442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:16.091546 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1456/2941] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Sep 16 19:47:15 2022] DELETE /identity/v3/users/e0adb7b5decd4ccab3a1c79d9594de7e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:47:16.276853 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] Authenticating user token {{(pid=81441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:47:16.278451 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.fernet_utils [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:47:16.295107 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919e74-f0c8-4629-91c7-4b19b4ca0ac3 admin admin] Validating token access rules against request {{(pid=81441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:47:16.300537 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:47:16.362255 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9ac1f3ebbc4a86af050232d3157e46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5d7d65acd0047cb8a5a68c90b00c1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:47:16.362866 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:47:16.363146 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:47:16.363419 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] PATH_INFO: `/v3/projects/0828c81cb5b646c9b2ea2045f1edcbf4` {{(pid=81441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:47:16.364591 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0828c81cb5b646c9b2ea2045f1edcbf4)` {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:47:16.366545 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] RBAC: Authorization granted {{(pid=81441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:47:16.413726 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0828c81cb5b646c9b2ea2045f1edcbf4', 'request_id': 'req-f392ac6b-aff6-4502-8f7a-487bce7791a1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:16.420046 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0828c81cb5b646c9b2ea2045f1edcbf4', 'request_id': 'req-f392ac6b-aff6-4502-8f7a-487bce7791a1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:16.425548 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0828c81cb5b646c9b2ea2045f1edcbf4', 'request_id': 'req-f392ac6b-aff6-4502-8f7a-487bce7791a1'} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:16.440570 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] The token cache is being invalidate because project 0828c81cb5b646c9b2ea2045f1edcbf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:47:16.440858 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:16.441496 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG keystone.notifications [None req-f392ac6b-aff6-4502-8f7a-487bce7791a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:47:16.443017 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: [pid: 81441|app: 0|req: 1486/2942] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Sep 16 19:47:16 2022] DELETE /identity/v3/projects/0828c81cb5b646c9b2ea2045f1edcbf4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:47:26.088284 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:47:26.438057 dv-cinder-850320-7-iscsi devstack@keystone.service[81441]: DEBUG dbcounter [-] [81441] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:51:14.234374 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] Authenticating user token {{(pid=81442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:51:14.236038 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:51:14.316340 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37276622-50ab-4cc3-9058-e1d6d9e89322 admin admin] Validating token access rules against request {{(pid=81442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:51:14.384880 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce70c0-c7e5-4771-a0c0-619403c0e708 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09ca68fdd5b4e178bcd6a5c8bccc4f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb58dd0ddf304a16a5ec9d3c60f684f2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:51:14.385496 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce70c0-c7e5-4771-a0c0-619403c0e708 service placement] REQUEST_METHOD: `GET` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:51:14.385769 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce70c0-c7e5-4771-a0c0-619403c0e708 service placement] SCRIPT_NAME: `/identity` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:51:14.386037 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce70c0-c7e5-4771-a0c0-619403c0e708 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:51:14.387966 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.fernet_utils [None req-f3ce70c0-c7e5-4771-a0c0-619403c0e708 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:51:14.400898 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce70c0-c7e5-4771-a0c0-619403c0e708 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:51:14.402494 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce70c0-c7e5-4771-a0c0-619403c0e708 service placement] RBAC: Authorization granted {{(pid=81442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:51:14.413495 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: [pid: 81442|app: 0|req: 1457/2943] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Sep 16 19:51:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:51:24.408589 dv-cinder-850320-7-iscsi devstack@keystone.service[81442]: DEBUG dbcounter [-] [81442] Writing DB stats keystone:SELECT=58 {{(pid=81442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}